-- Logs begin at Thu 2022-08-11 17:20:24 UTC, end at Thu 2022-08-11 18:45:18 UTC. -- Aug 11 18:14:03.549745 dv-osbrick-852824-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 11 18:14:03.557632 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 11 18:14:03 2022] *** Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: nodename: dv-osbrick-852824-1-ceph Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: machine: x86_64 Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: clock source: unix Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: pcre jit disabled Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: detected number of CPU cores: 4 Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: current working directory: / Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: detected binary path: /usr/bin/uwsgi-core Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: your processes number limit is 47680 Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: your memory page size is 4096 bytes Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: detected max file descriptor number: 2048 Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: lock engine: pthread robust mutexes Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: thunder lock: enabled Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 11 18:14:03.561336 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 11 18:14:03.608377 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: Python main interpreter initialized at 0x55680572b9c0 Aug 11 18:14:03.608377 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: python threads support enabled Aug 11 18:14:03.608377 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: your server socket listen backlog is limited to 100 connections Aug 11 18:14:03.608377 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: your mercy for graceful operations on workers is 90 seconds Aug 11 18:14:03.608753 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: mapped 403077 bytes (393 KB) for 2 cores Aug 11 18:14:03.608832 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: *** Operational MODE: preforking *** Aug 11 18:14:03.609067 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: *** uWSGI is running in multiple interpreter mode *** Aug 11 18:14:03.609067 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: spawned uWSGI master process (pid: 88279) Aug 11 18:14:03.609275 dv-osbrick-852824-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 11 18:14:03.611026 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: spawned uWSGI worker 1 (pid: 88294, cores: 1) Aug 11 18:14:03.611026 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: spawned uWSGI worker 2 (pid: 88295, cores: 1) Aug 11 18:14:03.611026 dv-osbrick-852824-1-ceph devstack@keystone.service[88279]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 11 18:14:09.427410 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 18:14:09.427410 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: from cryptography.utils import int_from_bytes Aug 11 18:14:09.428204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 18:14:09.428204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: from cryptography.utils import int_from_bytes Aug 11 18:14:09.430915 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 18:14:09.430915 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: from cryptography.utils import int_from_bytes Aug 11 18:14:09.431437 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 18:14:09.431437 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: from cryptography.utils import int_from_bytes Aug 11 18:14:09.476783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 18:14:09.476976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 18:14:09.477163 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] command line args: [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 18:14:09.477456 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 18:14:09.477631 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ================================================================================ {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 18:14:09.477886 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] admin_token = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.478125 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] config_dir = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.478311 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.478397 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 18:14:09.478477 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] config_source = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.478552 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 18:14:09.478653 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] debug = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.478769 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] command line args: [] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 18:14:09.478879 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.479152 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 18:14:09.479152 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ================================================================================ {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 18:14:09.479272 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.479464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] admin_token = **** {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.479547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.479622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] config_dir = [] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.479682 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.479844 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.479931 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480002 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] config_source = [] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480139 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] debug = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480297 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_config_append = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480360 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480616 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480709 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_dir = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480776 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480835 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_file = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.480976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.481102 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.481223 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.481330 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.481443 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] list_limit = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.481540 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.481662 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] log_config_append = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482014 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] log_dir = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482323 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482393 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] log_file = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482469 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482627 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482732 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.482957 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.483052 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.483183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.483267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.483343 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.483460 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.483533 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.483648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.483731 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.483833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.483917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.484106 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.484190 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.484338 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.484572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.484648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.484766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] publish_errors = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.484845 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.484974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.485052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.485202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.485282 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.485379 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.485526 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.485660 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.485844 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.486012 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.486090 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] standard_threads = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.486217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] publish_errors = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.486293 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.486432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.486514 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.486638 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.486764 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.487552 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.487670 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] use_journal = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.487670 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] use_json = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.487812 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.487891 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] use_stderr = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.487963 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.488084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] use_syslog = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.488160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] standard_threads = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.488235 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.488306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.488383 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.488454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.488523 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.488597 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.488597 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] use_journal = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.488734 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.488887 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] use_json = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.488962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.489036 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] use_stderr = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.489036 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] use_syslog = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.489172 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.489242 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 18:14:09.489318 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.489389 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.489459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.489526 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.489600 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.489670 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.489746 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.489881 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.489959 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.490128 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.490211 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.490362 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.490449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.490609 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.490717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.490872 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.490982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.491122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.491217 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.491369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.491466 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.491613 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.491696 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.491847 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.491945 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.492093 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.492205 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.492330 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.492453 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.492575 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.492692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.492820 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.493458 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.493633 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.493721 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.493968 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.494084 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.494212 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.494349 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.494433 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.494602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.494794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.494883 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.494955 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.495114 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.495191 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.495364 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.495475 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.495614 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.495698 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.495850 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.495939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.496080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.496174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.496313 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.496411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.496541 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.496620 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.496778 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.496867 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.497025 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.497109 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.497255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.497333 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.497486 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.497838 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.497981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.498065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.498209 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.498287 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.498439 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.498524 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.498700 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.498794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.498922 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.499031 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.499160 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.499248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.499397 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.499480 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.499624 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.499703 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.499852 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.499938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.500080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.500157 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.500307 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.500383 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.500538 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.500625 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.500776 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.500862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.501003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.501080 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.501239 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.501318 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.501471 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.501549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.501702 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.501780 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.501936 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.502014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.502169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.502248 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.502397 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.502474 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.502636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.502735 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.502900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.502987 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.503135 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.503213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.503366 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.503454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.503588 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.503664 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.503822 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.503901 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.504053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.504132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.504289 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.504374 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.504524 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.504610 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.504759 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.504840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.504990 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.505076 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.505248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.505328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.505484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.505562 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.505715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.505795 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.505949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.506026 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.506180 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.506259 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.506426 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.506506 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.506680 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.506772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.506919 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.506997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.507158 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.507238 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.507393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.507476 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.507624 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.507701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.507859 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.507952 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.508096 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.508180 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.508329 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.508406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.508622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.509260 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.509395 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.509595 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.509673 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.509861 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.509938 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.510105 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.510253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.510337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.510409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.510565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.510650 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.510840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.510914 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.511044 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.511124 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.511274 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.511352 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.511505 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.511585 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.511741 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.511825 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.511972 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.512050 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.512211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.512290 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.512448 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.512527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.512683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.512760 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.512913 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.512993 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.513144 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.513221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.513372 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.513450 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.513606 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.513686 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.513844 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.513929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.external = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.514075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.514153 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.514310 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.514388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.514560 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.514638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.514820 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.514899 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.password = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.515054 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.token = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.515134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.515294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.515402 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.515533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.515614 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.515766 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] auth.external = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.515889 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.515998 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.516122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.516296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.516375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.516529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.516608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.516760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] auth.password = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.516846 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.516999 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] auth.token = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.517118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.517216 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.517296 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.517453 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.517533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.517697 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.517785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.517927 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.518006 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.518172 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.518260 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.518418 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.518496 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.518649 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.518748 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.518904 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] credential.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.518985 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.519150 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.519228 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.519409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.519497 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.519647 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.519726 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.519884 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.519962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.520126 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.520216 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.520360 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.520438 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.520619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.520697 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.520871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.521049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.521127 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.521198 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.521340 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.521428 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.521586 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.521674 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.521816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.521895 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.522060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.522140 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.522297 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.522388 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.522554 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.522640 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.522813 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] federation.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.522893 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.523050 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.523146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.523290 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.523368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.523532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.523617 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.523761 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.523849 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.524004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.524084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.524262 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.524340 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.524513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.524719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.524937 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.525024 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.525097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.525199 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.525278 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.525436 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.525517 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.525683 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.525764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.525932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.526063 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.526151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.526318 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.526397 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.526568 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.526647 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.526829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.526925 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.527067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.527146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.527315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.527393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.527548 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.527635 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.527787 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.527866 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.528035 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.528114 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.528272 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.528418 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.528500 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.528571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.528719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.528797 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.528949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.529037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.529175 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.529253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.529409 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.529500 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.529644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.529725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.529880 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.529959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.530127 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.530211 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.530357 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.530437 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.530602 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.530704 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.530863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.530940 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.531095 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.531182 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.531329 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.531408 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.531558 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.531637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.531796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.531875 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.532031 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.532109 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.532261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.532339 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.532498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.532578 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.532733 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.532834 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.532963 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.533046 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.533196 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.533277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.533427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.533505 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.533670 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.533797 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.533912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.533992 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.534137 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.534215 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.534365 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.534443 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.534590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.534689 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.534848 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.534929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.535084 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.535162 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.535323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.535403 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.535555 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.535633 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.535784 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.535862 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.536023 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.536104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.536267 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.536350 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.536497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.536576 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.536724 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.536804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.536970 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.537048 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.537210 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.537288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.537441 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.537520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.537666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.537744 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.537897 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.537974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.538125 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.538205 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.538357 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.538435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.538585 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.538719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.538851 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.538932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.539093 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.539171 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.539337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.539478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.539563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.539636 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.539820 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.539906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.540050 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.540208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.540296 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.540515 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.540601 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.540750 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.540830 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.540982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.541070 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.541214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.541292 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.541456 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.541535 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.541701 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.541786 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.541933 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.542011 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.542179 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.542261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.542405 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.542492 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.542640 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.542780 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.542901 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.542980 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.543136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.543217 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.543369 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.543447 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.543601 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.543678 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.543824 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.543900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.544055 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.544134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.544288 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.544366 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.544525 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.544606 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.544771 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.544849 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.545017 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.545096 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.545250 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.545496 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.545581 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.545743 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.545960 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.546039 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.546208 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.546293 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.546442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.546590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.546726 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.546866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.546985 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] role.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.547110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.547232 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] role.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.547345 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.547462 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.547584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.547710 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.547825 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] resource.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.547956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.548076 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.548203 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.548323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.548449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.548558 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.548693 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.548807 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.548936 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.549056 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.549180 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.549298 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.549425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.549543 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.549656 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.549779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.549900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.550019 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.550144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.550253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] role.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.550389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.550499 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] role.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.550632 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.550775 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.550983 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.551061 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.551229 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.551309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.551477 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.551558 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.551723 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.551802 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.551967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.552046 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.552213 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.552293 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.552446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.552525 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.552692 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.552778 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.552922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.553001 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.553163 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.553241 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.553395 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.553482 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.553626 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.553705 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.553856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.553935 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.554104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.554244 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.554356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.554482 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.554602 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.554754 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.554874 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.555005 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.555110 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.555252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.555331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.556049 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.556131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.556345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.556487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.556691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.556805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.556944 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.557059 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.557203 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.557283 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.557450 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.557527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.557687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.557765 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.557928 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.558009 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.558170 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.558248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.558415 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.558493 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.558649 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.558764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.558911 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.559027 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.559144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.559222 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.559384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.559465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.559623 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] token.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.559701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.559848 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.559926 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.560090 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.560169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.560325 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.560402 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.560579 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.560658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.connection = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.560827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.560918 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.561063 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.561142 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.561305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.561383 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.561546 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.561633 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.561783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.561862 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.562016 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.562093 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.562249 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.562335 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.562481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.562558 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.562743 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.562826 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.562984 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.563076 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.563211 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.563289 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.563450 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.563529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.563695 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.563782 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.563928 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.564007 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.connection = **** {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.564170 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.564323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.564399 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.564470 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.564624 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.564705 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.564856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.564935 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.565027 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 18:14:09.565106 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.565336 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.565571 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.565806 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.566049 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.566283 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.566535 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.566807 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.567055 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.567289 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.567609 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.567757 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.567996 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.568230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 18:14:09.568398 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 18:14:09.597014 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.597246 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.597470 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.599531 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.599766 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.599992 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.606426 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.609068 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.635621 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.635848 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.636274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.636497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.701873 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.702239 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.751665 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.751902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.753020 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.753256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.816293 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.816523 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.816682 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.816770 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.816918 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.817002 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.817148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.817233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.817378 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.817518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.817596 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.817781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.841810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.842036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.842265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.842349 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.842496 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.842580 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.842719 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.842807 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.842949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.843080 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.843186 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.843269 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.843378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.843591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.854494 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.855017 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.867123 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.867353 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.867503 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.867592 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.867734 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.867821 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.868018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.868593 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.868790 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.868882 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.869006 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.869204 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.869481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.869698 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88295) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 18:14:09.886395 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.886601 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 18:14:09.886842 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.886968 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.887054 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 18:14:09.887166 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 18:14:09.887376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.887461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.887573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 18:14:09.887688 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.887866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.887953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.888089 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.888173 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.888347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.888602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.897780 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.898056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.898292 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.898377 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.898568 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.898652 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.898856 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.899134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.905836 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.906567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.908769 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.909050 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.909330 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.909497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.909608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.909778 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.909888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.910058 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.910142 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.910339 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.910421 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.910618 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.910890 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.910990 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.911069 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.911142 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.911214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.911410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.911555 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.911678 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.911946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.912212 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.935232 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.936560 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.936715 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.936998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.938036 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.938323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.941558 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.941845 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.942127 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.942927 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.943207 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.943486 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.948881 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.949167 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.950306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.950590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.953218 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.953458 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.953740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.954023 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.954301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.954659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.954766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.954964 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.955051 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.955234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.955315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.955514 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.955787 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.956185 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.956456 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.956727 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.971619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.971898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.973413 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.973689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.975795 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.978233 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.979629 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.979926 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.981591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.981886 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.984244 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.986240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.987433 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.989412 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:09.990555 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.990878 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.991185 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.991472 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.991751 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.992566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.992876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.993284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.993380 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.993767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.994054 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:09.995589 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.115428 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.115730 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.116000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.116261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.118733 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.119234 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.119686 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.119961 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.123819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.125472 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.125751 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.126995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.128415 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.128640 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.128724 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.128916 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.129013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.129234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.129516 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.131646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.131931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.132214 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.132498 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.132779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.141286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.141561 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.141842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.142119 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.142396 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.142691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.142974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.144832 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.145114 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.145396 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.145676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.145958 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.146233 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.146508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.158198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.161123 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.162126 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.164137 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.165213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.165608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.167099 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.167380 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.167663 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.168393 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.169824 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.171305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.171587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.171867 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.174106 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.175607 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.178487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.178615 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.178802 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.179095 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.179372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.180123 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.183889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.184179 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.184463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.184743 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.188144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.188433 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.188710 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.192665 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.192956 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.193235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.195492 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.195877 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.196721 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.197103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.197554 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.197839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.198133 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.198419 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.198722 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.198999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.199283 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.199549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.199827 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.200103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.200981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88295) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 18:14:10.201367 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.201648 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.201927 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.202205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.202481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.202787 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.203071 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.203387 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.203614 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.203892 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.204152 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.204431 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.204726 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88295) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 18:14:10.233145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55680572b9c0 pid: 88294 (default app) Aug 11 18:14:10.236769 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48f55b-732d-4e0f-a2db-6c1527c4352b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:10.237060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48f55b-732d-4e0f-a2db-6c1527c4352b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:10.237332 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48f55b-732d-4e0f-a2db-6c1527c4352b None None] PATH_INFO: `/v3` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:10.238353 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55680572b9c0 pid: 88295 (default app) Aug 11 18:14:10.241527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Thu Aug 11 18:14:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:19.267535 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978c70-80f5-4112-9f9e-e0f2d2ed5020 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:19.268099 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978c70-80f5-4112-9f9e-e0f2d2ed5020 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:19.268099 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978c70-80f5-4112-9f9e-e0f2d2ed5020 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:19.272570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:14:19.278722 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:19.317595 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:19.317595 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:19.388177 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: INFO dbcounter [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] Registered counter for database keystone Aug 11 18:14:19.407940 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG oslo_db.sqlalchemy.engines [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 18:14:19.413991 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writer thread running {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 18:14:19.592901 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG passlib.handlers.bcrypt [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88294) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 11 18:14:19.593245 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG passlib.handlers.bcrypt [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88294) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 11 18:14:19.647360 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:19.648955 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:19.780106 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 11 18:14:20.330898 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54978c70-80f5-4112-9f9e-e0f2d2ed5020 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:20.406616 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: INFO dbcounter [None req-54978c70-80f5-4112-9f9e-e0f2d2ed5020 None None] Registered counter for database keystone Aug 11 18:14:20.428010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG oslo_db.sqlalchemy.engines [None req-54978c70-80f5-4112-9f9e-e0f2d2ed5020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 18:14:20.434674 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writer thread running {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 18:14:20.553192 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54978c70-80f5-4112-9f9e-e0f2d2ed5020 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:20.557494 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559d1b2-3b54-46d6-aacf-5069ba54908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:20.558103 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559d1b2-3b54-46d6-aacf-5069ba54908e admin admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:20.558378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559d1b2-3b54-46d6-aacf-5069ba54908e admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:20.558645 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559d1b2-3b54-46d6-aacf-5069ba54908e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:20.566786 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559d1b2-3b54-46d6-aacf-5069ba54908e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:20.618137 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e559d1b2-3b54-46d6-aacf-5069ba54908e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 11 18:14:20.619033 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559d1b2-3b54-46d6-aacf-5069ba54908e admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:20.628900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Aug 11 18:14:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 18:14:20.635433 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:20.650018 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3e83f-c624-409d-8c9c-7a8c9bb9996d None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:20.654600 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654ac56-a812-42e4-a6f8-aa793428c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:20.655731 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654ac56-a812-42e4-a6f8-aa793428c302 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:20.656020 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654ac56-a812-42e4-a6f8-aa793428c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:20.656297 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654ac56-a812-42e4-a6f8-aa793428c302 admin admin] PATH_INFO: `/v3/projects/83c912d6fcae45219e4abbd9eb74f129` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:20.657868 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654ac56-a812-42e4-a6f8-aa793428c302 admin admin] RBAC: Authorizing `identity:get_project(project_id=83c912d6fcae45219e4abbd9eb74f129)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:20.710857 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9654ac56-a812-42e4-a6f8-aa793428c302 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 11 18:14:20.711205 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654ac56-a812-42e4-a6f8-aa793428c302 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:20.716093 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Thu Aug 11 18:14:20 2022] GET /identity/v3/projects/83c912d6fcae45219e4abbd9eb74f129 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:14:22.881310 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f332-d5b1-4a65-bccc-d158dafb3d5d None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:22.881840 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f332-d5b1-4a65-bccc-d158dafb3d5d None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:22.881840 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f332-d5b1-4a65-bccc-d158dafb3d5d None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:22.886100 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:22.891595 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec628a-f01a-4508-b823-4c451d7200b3 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:22.892095 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec628a-f01a-4508-b823-4c451d7200b3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:22.892191 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec628a-f01a-4508-b823-4c451d7200b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:22.912341 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1dec628a-f01a-4508-b823-4c451d7200b3 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:22.913867 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1dec628a-f01a-4508-b823-4c451d7200b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:22.922476 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 11 18:14:23.251164 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28f332-d5b1-4a65-bccc-d158dafb3d5d None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:23.263841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28f332-d5b1-4a65-bccc-d158dafb3d5d None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:23.268047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd48bb-e910-499d-b278-89c03e5f83a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:23.268631 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd48bb-e910-499d-b278-89c03e5f83a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:23.268908 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd48bb-e910-499d-b278-89c03e5f83a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:23.269180 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd48bb-e910-499d-b278-89c03e5f83a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:23.277359 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd48bb-e910-499d-b278-89c03e5f83a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:23.279160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd48bb-e910-499d-b278-89c03e5f83a7 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:23.287682 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Aug 11 18:14:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 18:14:23.293041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec628a-f01a-4508-b823-4c451d7200b3 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:23.302186 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec628a-f01a-4508-b823-4c451d7200b3 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:23.306891 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82fe0b-b08f-4dec-af33-e5f0a52ab035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:23.307514 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82fe0b-b08f-4dec-af33-e5f0a52ab035 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:23.307798 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82fe0b-b08f-4dec-af33-e5f0a52ab035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:23.308075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82fe0b-b08f-4dec-af33-e5f0a52ab035 admin admin] PATH_INFO: `/v3/users/88fec54a2c514363b52e38552e10c343` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:23.309403 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82fe0b-b08f-4dec-af33-e5f0a52ab035 admin admin] RBAC: Authorizing `identity:get_user(user_id=88fec54a2c514363b52e38552e10c343)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:23.311297 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82fe0b-b08f-4dec-af33-e5f0a52ab035 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:23.312809 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Thu Aug 11 18:14:23 2022] GET /identity/v3/users/88fec54a2c514363b52e38552e10c343 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:25.543359 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6579b5-8c48-4980-b037-03691fadb7e8 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:25.543912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6579b5-8c48-4980-b037-03691fadb7e8 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:25.543912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6579b5-8c48-4980-b037-03691fadb7e8 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:25.545219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:14:25.550419 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d5ed2-a74a-48b6-bea1-504f17e3eca3 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:25.550833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d5ed2-a74a-48b6-bea1-504f17e3eca3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:25.551016 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d5ed2-a74a-48b6-bea1-504f17e3eca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:25.568712 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-cb5d5ed2-a74a-48b6-bea1-504f17e3eca3 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:25.569900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-cb5d5ed2-a74a-48b6-bea1-504f17e3eca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:25.643486 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c22f72-231e-4046-a207-985d75092ffd None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:25.643767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c22f72-231e-4046-a207-985d75092ffd None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:25.644047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c22f72-231e-4046-a207-985d75092ffd None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:25.645379 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:14:25.650275 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c484-f66d-4bda-a4d3-a8abbd88e356 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:25.650550 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c484-f66d-4bda-a4d3-a8abbd88e356 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:25.650858 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c484-f66d-4bda-a4d3-a8abbd88e356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:25.651197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:25.694648 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG passlib.handlers.bcrypt [None req-c2e8c484-f66d-4bda-a4d3-a8abbd88e356 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88295) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 11 18:14:25.695107 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG passlib.handlers.bcrypt [None req-c2e8c484-f66d-4bda-a4d3-a8abbd88e356 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88295) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 11 18:14:25.741042 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-c2e8c484-f66d-4bda-a4d3-a8abbd88e356 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:25.742616 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-c2e8c484-f66d-4bda-a4d3-a8abbd88e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:25.843391 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:14:25.976463 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d5ed2-a74a-48b6-bea1-504f17e3eca3 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:26.000780 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:26.079032 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d5ed2-a74a-48b6-bea1-504f17e3eca3 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:26.112822 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983386-000d-4dc5-9627-a0b68fab004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:26.113392 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983386-000d-4dc5-9627-a0b68fab004d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:26.113675 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983386-000d-4dc5-9627-a0b68fab004d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:26.113950 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983386-000d-4dc5-9627-a0b68fab004d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:26.125880 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe983386-000d-4dc5-9627-a0b68fab004d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-fe983386-000d-4dc5-9627-a0b68fab004d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:26.135752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:26.136729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:14:26.137740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:26.144478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c484-f66d-4bda-a4d3-a8abbd88e356 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:26.164597 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983386-000d-4dc5-9627-a0b68fab004d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:26.245018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c484-f66d-4bda-a4d3-a8abbd88e356 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:26.245589 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:26.247473 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:26.265109 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983386-000d-4dc5-9627-a0b68fab004d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:26.281206 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f2414-f91a-4c6b-adc1-71a64c021be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:26.282068 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2414-f91a-4c6b-adc1-71a64c021be9 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:26.282347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2414-f91a-4c6b-adc1-71a64c021be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:26.282620 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2414-f91a-4c6b-adc1-71a64c021be9 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:26.283474 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2414-f91a-4c6b-adc1-71a64c021be9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:26.283777 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2414-f91a-4c6b-adc1-71a64c021be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:26.285244 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2414-f91a-4c6b-adc1-71a64c021be9 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:26.299196 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:26.299356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcc13d-4c43-4ec0-8dbb-69db21ccfe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:26.299894 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcc13d-4c43-4ec0-8dbb-69db21ccfe9a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:26.300174 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcc13d-4c43-4ec0-8dbb-69db21ccfe9a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:26.300521 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcc13d-4c43-4ec0-8dbb-69db21ccfe9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:26.304936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f2414-f91a-4c6b-adc1-71a64c021be9 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:26.369320 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcc13d-4c43-4ec0-8dbb-69db21ccfe9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:26.370764 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcc13d-4c43-4ec0-8dbb-69db21ccfe9a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:26.404356 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f2414-f91a-4c6b-adc1-71a64c021be9 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:26.437995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9b3a2-f8bb-4b93-a263-1c8a90178c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:26.438886 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b3a2-f8bb-4b93-a263-1c8a90178c4c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:26.439176 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b3a2-f8bb-4b93-a263-1c8a90178c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:26.439453 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9b3a2-f8bb-4b93-a263-1c8a90178c4c None admin] PATH_INFO: `/v3/users/88fec54a2c514363b52e38552e10c343` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:26.440994 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9b3a2-f8bb-4b93-a263-1c8a90178c4c None admin] RBAC: Authorizing `identity:get_user(user_id=88fec54a2c514363b52e38552e10c343)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:26.442450 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9b3a2-f8bb-4b93-a263-1c8a90178c4c None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:26.444066 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 9/16] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:26 2022] GET /identity/v3/users/88fec54a2c514363b52e38552e10c343 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:26.450062 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9b3a2-f8bb-4b93-a263-1c8a90178c4c None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:26.450955 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:26.470803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 18:14:26.476870 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcc13d-4c43-4ec0-8dbb-69db21ccfe9a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:26.484875 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:26.550342 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9b3a2-f8bb-4b93-a263-1c8a90178c4c None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:26.576745 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcc13d-4c43-4ec0-8dbb-69db21ccfe9a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:26.585721 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d510b20-fd9a-45fc-ba8a-11b6b92bf036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:26.586340 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d510b20-fd9a-45fc-ba8a-11b6b92bf036 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:26.589491 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d510b20-fd9a-45fc-ba8a-11b6b92bf036 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:26.589491 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d510b20-fd9a-45fc-ba8a-11b6b92bf036 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:26.589491 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d510b20-fd9a-45fc-ba8a-11b6b92bf036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:26.590086 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d510b20-fd9a-45fc-ba8a-11b6b92bf036 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:26.591674 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:14:26.597496 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d510b20-fd9a-45fc-ba8a-11b6b92bf036 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:26.611143 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90d191-5ede-49d1-97ba-68153fe38a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:26.611779 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90d191-5ede-49d1-97ba-68153fe38a1b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:26.612073 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90d191-5ede-49d1-97ba-68153fe38a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:26.612420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90d191-5ede-49d1-97ba-68153fe38a1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:26.623563 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90d191-5ede-49d1-97ba-68153fe38a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:26.625032 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90d191-5ede-49d1-97ba-68153fe38a1b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-da90d191-5ede-49d1-97ba-68153fe38a1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:14:26.641337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:26.642202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:14:26.643183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:14:26.643183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:14:26.643183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:14:26.643183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:14:26.648396 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90d191-5ede-49d1-97ba-68153fe38a1b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:26.683271 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:26.708790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d510b20-fd9a-45fc-ba8a-11b6b92bf036 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:26.710348 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:26.750575 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0d8aa-47fd-4209-90c0-640cca8d833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:26.751213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0d8aa-47fd-4209-90c0-640cca8d833f None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:26.751333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90d191-5ede-49d1-97ba-68153fe38a1b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:26.751497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0d8aa-47fd-4209-90c0-640cca8d833f None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:26.751767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0d8aa-47fd-4209-90c0-640cca8d833f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:26.752492 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0d8aa-47fd-4209-90c0-640cca8d833f None admin] RBAC: Adding query filter params (role.id=f89efd1f713043d8835c127de30f53ca, scope.domain.id=default, user.id=88fec54a2c514363b52e38552e10c343) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:26.752801 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0d8aa-47fd-4209-90c0-640cca8d833f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:26.754247 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0d8aa-47fd-4209-90c0-640cca8d833f None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:26.763202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Aug 11 18:14:26 2022] GET /identity/v3/role_assignments?user.id=88fec54a2c514363b52e38552e10c343&scope.domain.id=default&role.id=f89efd1f713043d8835c127de30f53ca => generated 233 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:14:26.788287 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ebc73-b488-4bb8-b84e-e01b8beb77c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:26.788915 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ebc73-b488-4bb8-b84e-e01b8beb77c1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:26.789199 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ebc73-b488-4bb8-b84e-e01b8beb77c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:26.789476 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ebc73-b488-4bb8-b84e-e01b8beb77c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:26.790138 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ebc73-b488-4bb8-b84e-e01b8beb77c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:26.790638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ebc73-b488-4bb8-b84e-e01b8beb77c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:26.792429 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ebc73-b488-4bb8-b84e-e01b8beb77c1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:26.812453 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:14:29.319719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dce0d-bfc4-4688-ab41-84126c826294 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:29.320728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dce0d-bfc4-4688-ab41-84126c826294 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:29.321229 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dce0d-bfc4-4688-ab41-84126c826294 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:29.323655 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:29.340162 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ffe6-7331-463d-b3be-e0a2e8dafa5c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:29.341058 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ffe6-7331-463d-b3be-e0a2e8dafa5c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:29.341530 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ffe6-7331-463d-b3be-e0a2e8dafa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:29.367108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c735ffe6-7331-463d-b3be-e0a2e8dafa5c None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:29.368686 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c735ffe6-7331-463d-b3be-e0a2e8dafa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:29.456141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:14:29.855984 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f723435-01ac-4b32-b2ba-58ea48b42a6b None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:29.856775 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f723435-01ac-4b32-b2ba-58ea48b42a6b None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:29.857255 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f723435-01ac-4b32-b2ba-58ea48b42a6b None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:29.858802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:29.864237 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacaad8-2d0c-4d10-9fe9-018756ba6c37 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:29.864731 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacaad8-2d0c-4d10-9fe9-018756ba6c37 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:29.865194 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacaad8-2d0c-4d10-9fe9-018756ba6c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:29.889839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1bacaad8-2d0c-4d10-9fe9-018756ba6c37 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:29.891372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1bacaad8-2d0c-4d10-9fe9-018756ba6c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:29.914961 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:29.986840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 12/25] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:30.097313 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f723435-01ac-4b32-b2ba-58ea48b42a6b None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:30.133739 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f481168-018e-4d76-a23b-bae2de3095f4 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.134090 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f481168-018e-4d76-a23b-bae2de3095f4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.134579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f481168-018e-4d76-a23b-bae2de3095f4 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.136154 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 13/26] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:30.141239 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243405-7982-47d9-83b4-141134777344 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.141530 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243405-7982-47d9-83b4-141134777344 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.141838 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243405-7982-47d9-83b4-141134777344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.168711 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-71243405-7982-47d9-83b4-141134777344 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:30.169923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-71243405-7982-47d9-83b4-141134777344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:30.251565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 14/27] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:14:30.252598 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ef157-d592-42c8-a7bf-5e9c603bbc0e None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.252876 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ef157-d592-42c8-a7bf-5e9c603bbc0e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.253157 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ef157-d592-42c8-a7bf-5e9c603bbc0e None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.254384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 15/28] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:30.260456 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c8368-b739-4f94-bf76-60989caca740 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.260744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c8368-b739-4f94-bf76-60989caca740 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.261025 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c8368-b739-4f94-bf76-60989caca740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.262209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f723435-01ac-4b32-b2ba-58ea48b42a6b None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:30.299746 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-399c8368-b739-4f94-bf76-60989caca740 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:30.300649 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dda6f-3ccf-4247-9d69-61ab12d5ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:30.301053 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-399c8368-b739-4f94-bf76-60989caca740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:30.301337 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dda6f-3ccf-4247-9d69-61ab12d5ea76 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.301664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dda6f-3ccf-4247-9d69-61ab12d5ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.301936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dda6f-3ccf-4247-9d69-61ab12d5ea76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.315613 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3dda6f-3ccf-4247-9d69-61ab12d5ea76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-ad3dda6f-3ccf-4247-9d69-61ab12d5ea76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:30.325323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:30.326587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:30.327949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 14/29] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:30.332654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dda6f-3ccf-4247-9d69-61ab12d5ea76 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:30.389211 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:30.432909 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 16/30] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:14:30.496072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c8368-b739-4f94-bf76-60989caca740 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:30.516561 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:30.523879 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dda6f-3ccf-4247-9d69-61ab12d5ea76 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:30.593657 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec06bf-1d3e-4131-af97-6662b1fd96f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:30.594277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec06bf-1d3e-4131-af97-6662b1fd96f1 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.594569 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec06bf-1d3e-4131-af97-6662b1fd96f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.594868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec06bf-1d3e-4131-af97-6662b1fd96f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.595547 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec06bf-1d3e-4131-af97-6662b1fd96f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:30.595855 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec06bf-1d3e-4131-af97-6662b1fd96f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:30.597262 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec06bf-1d3e-4131-af97-6662b1fd96f1 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:30.615366 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 15/31] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:30.621724 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec06bf-1d3e-4131-af97-6662b1fd96f1 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:30.635105 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c8368-b739-4f94-bf76-60989caca740 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:30.692445 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afa11d-2741-4a61-8a1c-661b295d4575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:30.693117 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afa11d-2741-4a61-8a1c-661b295d4575 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.693307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afa11d-2741-4a61-8a1c-661b295d4575 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.693551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afa11d-2741-4a61-8a1c-661b295d4575 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.694230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afa11d-2741-4a61-8a1c-661b295d4575 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:30.695650 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afa11d-2741-4a61-8a1c-661b295d4575 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:30.722468 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:30.736583 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec06bf-1d3e-4131-af97-6662b1fd96f1 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:30.773035 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762930c-56ab-4b58-8083-fdc84321904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:30.773940 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762930c-56ab-4b58-8083-fdc84321904b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.774448 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762930c-56ab-4b58-8083-fdc84321904b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.774997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762930c-56ab-4b58-8083-fdc84321904b None admin] PATH_INFO: `/v3/users/88fec54a2c514363b52e38552e10c343` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.776588 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762930c-56ab-4b58-8083-fdc84321904b None admin] RBAC: Authorizing `identity:get_user(user_id=88fec54a2c514363b52e38552e10c343)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:30.778192 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762930c-56ab-4b58-8083-fdc84321904b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:30.780045 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 16/32] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:30 2022] GET /identity/v3/users/88fec54a2c514363b52e38552e10c343 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:30.781393 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298975d4-3ee2-43d0-9e1a-1ddccdb06220 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.781866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298975d4-3ee2-43d0-9e1a-1ddccdb06220 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.782354 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298975d4-3ee2-43d0-9e1a-1ddccdb06220 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.783856 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 17/33] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:30.785651 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298975d4-3ee2-43d0-9e1a-1ddccdb06220 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:30.901209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298975d4-3ee2-43d0-9e1a-1ddccdb06220 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:30.931590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 17/34] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Aug 11 18:14:30 2022] POST /identity/v3/roles => generated 219 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:14:30.933049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f3148-9af0-49ea-b24a-462c752e174c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.933420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f3148-9af0-49ea-b24a-462c752e174c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.933741 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f3148-9af0-49ea-b24a-462c752e174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.943935 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e689c-f29e-4b83-9188-17d3d2ac7f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:30.944921 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e689c-f29e-4b83-9188-17d3d2ac7f15 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:30.945404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e689c-f29e-4b83-9188-17d3d2ac7f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:30.945962 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e689c-f29e-4b83-9188-17d3d2ac7f15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:30.947641 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e689c-f29e-4b83-9188-17d3d2ac7f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:30.949485 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e689c-f29e-4b83-9188-17d3d2ac7f15 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:30.954845 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 18/35] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:14:30.956304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c82f3148-9af0-49ea-b24a-462c752e174c None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:30.957695 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e689c-f29e-4b83-9188-17d3d2ac7f15 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:30.958862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c82f3148-9af0-49ea-b24a-462c752e174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:30.988864 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:31.046853 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 18/36] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:31.047913 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f3148-9af0-49ea-b24a-462c752e174c None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:31.071125 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:31.090971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e689c-f29e-4b83-9188-17d3d2ac7f15 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:31.151761 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fc278-1c7f-49c4-b064-496daf7e49ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:31.152689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fc278-1c7f-49c4-b064-496daf7e49ea None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:31.153143 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fc278-1c7f-49c4-b064-496daf7e49ea None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:31.153621 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fc278-1c7f-49c4-b064-496daf7e49ea None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:31.154371 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fc278-1c7f-49c4-b064-496daf7e49ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:31.156195 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fc278-1c7f-49c4-b064-496daf7e49ea None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:31.217315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f3148-9af0-49ea-b24a-462c752e174c None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:31.273716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3228a5-eb79-44d2-bde9-f275b178c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:31.275357 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3228a5-eb79-44d2-bde9-f275b178c94e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:31.275869 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3228a5-eb79-44d2-bde9-f275b178c94e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:31.276345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3228a5-eb79-44d2-bde9-f275b178c94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:31.288608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3228a5-eb79-44d2-bde9-f275b178c94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:31.293129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3228a5-eb79-44d2-bde9-f275b178c94e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-8b3228a5-eb79-44d2-bde9-f275b178c94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:14:31.309538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:31.310389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:14:31.311211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:14:31.311211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:14:31.311211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:14:31.313010 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 19/37] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:31.314056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3228a5-eb79-44d2-bde9-f275b178c94e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:31.354926 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 19/38] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Aug 11 18:14:30 2022] POST /identity/v3/roles => generated 225 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:14:31.355919 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fc278-1c7f-49c4-b064-496daf7e49ea None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:31.384573 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:31.439060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3228a5-eb79-44d2-bde9-f275b178c94e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:31.457032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:31.475988 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fc278-1c7f-49c4-b064-496daf7e49ea None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:31.479119 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036b016-07f7-4cfa-a23f-47e2fb36fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:31.479899 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036b016-07f7-4cfa-a23f-47e2fb36fd8e None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:31.480196 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036b016-07f7-4cfa-a23f-47e2fb36fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:31.480535 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036b016-07f7-4cfa-a23f-47e2fb36fd8e None admin] PATH_INFO: `/v3/domains/default/users/88fec54a2c514363b52e38552e10c343/roles/f89efd1f713043d8835c127de30f53ca` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:31.483632 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036b016-07f7-4cfa-a23f-47e2fb36fd8e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=88fec54a2c514363b52e38552e10c343, role_id=f89efd1f713043d8835c127de30f53ca)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:31.485022 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036b016-07f7-4cfa-a23f-47e2fb36fd8e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:31.518981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f8eda-d5ba-4211-92e3-24647375b527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:31.519602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f8eda-d5ba-4211-92e3-24647375b527 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:31.519883 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f8eda-d5ba-4211-92e3-24647375b527 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:31.520157 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f8eda-d5ba-4211-92e3-24647375b527 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:31.520815 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f8eda-d5ba-4211-92e3-24647375b527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:31.521140 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f8eda-d5ba-4211-92e3-24647375b527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:31.522658 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f8eda-d5ba-4211-92e3-24647375b527 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:31.545001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 20/39] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:31.546693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2435e-9b03-4d56-acf7-06d149a7c181 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:31.546983 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2435e-9b03-4d56-acf7-06d149a7c181 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:31.547262 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2435e-9b03-4d56-acf7-06d149a7c181 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:31.548488 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 21/40] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:31.549174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2435e-9b03-4d56-acf7-06d149a7c181 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:31.556944 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 20/41] 10.222.0.15 () {58 vars in 1361 bytes} [Thu Aug 11 18:14:31 2022] PUT /identity/v3/domains/default/users/88fec54a2c514363b52e38552e10c343/roles/f89efd1f713043d8835c127de30f53ca => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:14:31.557775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036b016-07f7-4cfa-a23f-47e2fb36fd8e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:31.690367 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2435e-9b03-4d56-acf7-06d149a7c181 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:31.697536 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036b016-07f7-4cfa-a23f-47e2fb36fd8e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:31.719623 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:31.742244 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af420656-bde1-4390-b288-4617bf5d7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:31.742869 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39548ee3-ec3d-46fb-b2cb-3ebe405c0099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:31.742988 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420656-bde1-4390-b288-4617bf5d7915 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:31.743172 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420656-bde1-4390-b288-4617bf5d7915 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:31.744051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39548ee3-ec3d-46fb-b2cb-3ebe405c0099 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:31.744350 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39548ee3-ec3d-46fb-b2cb-3ebe405c0099 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:31.744484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420656-bde1-4390-b288-4617bf5d7915 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:31.744650 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39548ee3-ec3d-46fb-b2cb-3ebe405c0099 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:31.745167 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af420656-bde1-4390-b288-4617bf5d7915 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:31.745842 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39548ee3-ec3d-46fb-b2cb-3ebe405c0099 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:31.747731 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af420656-bde1-4390-b288-4617bf5d7915 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:31.747806 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39548ee3-ec3d-46fb-b2cb-3ebe405c0099 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:31.820554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Aug 11 18:14:31 2022] POST /identity/v3/roles => generated 223 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:14:31.822552 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54593d43-88ff-4edc-9e11-429cc647c31f None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:31.822907 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54593d43-88ff-4edc-9e11-429cc647c31f None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:31.823232 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54593d43-88ff-4edc-9e11-429cc647c31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:31.830938 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:31.847154 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-54593d43-88ff-4edc-9e11-429cc647c31f None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:31.848850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-54593d43-88ff-4edc-9e11-429cc647c31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:31.861521 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 21/43] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 11 18:14:31 2022] POST /identity/v3/projects => generated 301 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:14:31.945959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 23/44] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:32.279920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af420656-bde1-4390-b288-4617bf5d7915 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:32.378912 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af420656-bde1-4390-b288-4617bf5d7915 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:32.411587 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b17da7-18e2-421f-9e73-de475b948447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:32.412204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b17da7-18e2-421f-9e73-de475b948447 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:32.412485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b17da7-18e2-421f-9e73-de475b948447 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:32.412760 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b17da7-18e2-421f-9e73-de475b948447 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:32.413854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b17da7-18e2-421f-9e73-de475b948447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:32.415847 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b17da7-18e2-421f-9e73-de475b948447 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:32.417763 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 22/45] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:32.423612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54593d43-88ff-4edc-9e11-429cc647c31f None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:32.520837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54593d43-88ff-4edc-9e11-429cc647c31f None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:32.554943 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d614f-aeed-4e87-9b4a-0e29b3373c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:32.555478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d614f-aeed-4e87-9b4a-0e29b3373c89 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:32.555759 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d614f-aeed-4e87-9b4a-0e29b3373c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:32.556099 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d614f-aeed-4e87-9b4a-0e29b3373c89 None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:32.556900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d614f-aeed-4e87-9b4a-0e29b3373c89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:32.558340 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d614f-aeed-4e87-9b4a-0e29b3373c89 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:32.563283 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:32.667433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 11 18:14:32 2022] POST /identity/v3/projects => generated 312 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:14:33.801604 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d37db-b004-4bfd-bfe6-eb46543f4843 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:33.802116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d37db-b004-4bfd-bfe6-eb46543f4843 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:33.802198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d37db-b004-4bfd-bfe6-eb46543f4843 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:33.803561 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 23/47] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:33.809400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539543-6ee3-4603-b19d-52365bb268d0 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:33.809798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539543-6ee3-4603-b19d-52365bb268d0 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:33.809972 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539543-6ee3-4603-b19d-52365bb268d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:33.829270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-de539543-6ee3-4603-b19d-52365bb268d0 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:33.830456 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-de539543-6ee3-4603-b19d-52365bb268d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:33.897940 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:34.229618 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d37db-b004-4bfd-bfe6-eb46543f4843 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:34.266451 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:34.334137 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d37db-b004-4bfd-bfe6-eb46543f4843 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:34.368208 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d4e0e-0e49-4da4-b350-fa5e2457405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:34.369452 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d4e0e-0e49-4da4-b350-fa5e2457405c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:34.369731 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d4e0e-0e49-4da4-b350-fa5e2457405c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:34.370002 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d4e0e-0e49-4da4-b350-fa5e2457405c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:34.380209 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d4e0e-0e49-4da4-b350-fa5e2457405c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-8a6d4e0e-0e49-4da4-b350-fa5e2457405c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:34.386043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:34.387056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:14:34.387804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 24/49] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:14:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:14:34.393219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539543-6ee3-4603-b19d-52365bb268d0 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:34.491622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539543-6ee3-4603-b19d-52365bb268d0 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:34.508364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:34.527301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f85121-5d13-4e97-954f-0284e649a34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:34.527916 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f85121-5d13-4e97-954f-0284e649a34c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:34.528201 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f85121-5d13-4e97-954f-0284e649a34c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:34.528477 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f85121-5d13-4e97-954f-0284e649a34c None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:34.529147 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f85121-5d13-4e97-954f-0284e649a34c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:34.529454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f85121-5d13-4e97-954f-0284e649a34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:34.530971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f85121-5d13-4e97-954f-0284e649a34c None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:34.539644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 26/50] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:34.544991 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d4e0e-0e49-4da4-b350-fa5e2457405c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:34.640739 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:34.646436 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d4e0e-0e49-4da4-b350-fa5e2457405c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:34.681113 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321e643-4725-493c-82b5-eb70947c7bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:34.682248 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321e643-4725-493c-82b5-eb70947c7bea None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:34.682526 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321e643-4725-493c-82b5-eb70947c7bea None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:34.682827 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321e643-4725-493c-82b5-eb70947c7bea None admin] PATH_INFO: `/v3/users/88fec54a2c514363b52e38552e10c343` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:34.683952 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321e643-4725-493c-82b5-eb70947c7bea None admin] RBAC: Authorizing `identity:get_user(user_id=88fec54a2c514363b52e38552e10c343)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:34.685450 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321e643-4725-493c-82b5-eb70947c7bea None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:34.687062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 25/51] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:34 2022] GET /identity/v3/users/88fec54a2c514363b52e38552e10c343 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:34.692643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f85121-5d13-4e97-954f-0284e649a34c None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:34.796650 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f85121-5d13-4e97-954f-0284e649a34c None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:34.830871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38799b9-da0a-45dc-8c4d-379e8cc14a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:34.831515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38799b9-da0a-45dc-8c4d-379e8cc14a42 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:34.831749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38799b9-da0a-45dc-8c4d-379e8cc14a42 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:34.832022 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38799b9-da0a-45dc-8c4d-379e8cc14a42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:34.833120 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38799b9-da0a-45dc-8c4d-379e8cc14a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:34.834654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38799b9-da0a-45dc-8c4d-379e8cc14a42 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:34.836369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 27/52] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:34.842236 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321e643-4725-493c-82b5-eb70947c7bea None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:34.876131 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc86275-0703-406f-96c0-e9c00429f09d None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:34.876419 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc86275-0703-406f-96c0-e9c00429f09d None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:34.876700 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc86275-0703-406f-96c0-e9c00429f09d None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:34.878046 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 28/53] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:34.882937 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9668dd-a72d-4f8b-a250-948019d60ac2 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:34.883220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9668dd-a72d-4f8b-a250-948019d60ac2 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:34.883509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9668dd-a72d-4f8b-a250-948019d60ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:34.902427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-3d9668dd-a72d-4f8b-a250-948019d60ac2 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:34.903731 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-3d9668dd-a72d-4f8b-a250-948019d60ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:34.947253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:34.951985 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321e643-4725-493c-82b5-eb70947c7bea None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:34.971357 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 29/54] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:14:34.986819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57032871-e4e4-42ee-83fc-e44e8b1126b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:34.987428 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57032871-e4e4-42ee-83fc-e44e8b1126b3 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:34.987722 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57032871-e4e4-42ee-83fc-e44e8b1126b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:34.987989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57032871-e4e4-42ee-83fc-e44e8b1126b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:34.988714 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57032871-e4e4-42ee-83fc-e44e8b1126b3 None admin] RBAC: Adding query filter params (role.id=f89efd1f713043d8835c127de30f53ca, scope.domain.id=default, user.id=88fec54a2c514363b52e38552e10c343) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:34.989025 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57032871-e4e4-42ee-83fc-e44e8b1126b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:34.990483 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57032871-e4e4-42ee-83fc-e44e8b1126b3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:34.997470 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 26/55] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Aug 11 18:14:34 2022] GET /identity/v3/role_assignments?user.id=88fec54a2c514363b52e38552e10c343&scope.domain.id=default&role.id=f89efd1f713043d8835c127de30f53ca => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:35.301326 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9668dd-a72d-4f8b-a250-948019d60ac2 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:35.399521 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9668dd-a72d-4f8b-a250-948019d60ac2 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:35.433612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c14a1-359c-4f69-a30e-0c7a2841df17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:35.434238 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c14a1-359c-4f69-a30e-0c7a2841df17 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:35.434523 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c14a1-359c-4f69-a30e-0c7a2841df17 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:35.434834 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c14a1-359c-4f69-a30e-0c7a2841df17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:35.435983 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c14a1-359c-4f69-a30e-0c7a2841df17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:35.437517 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c14a1-359c-4f69-a30e-0c7a2841df17 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:35.439102 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 30/56] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:35.444967 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57032871-e4e4-42ee-83fc-e44e8b1126b3 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:35.474346 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:35.545174 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57032871-e4e4-42ee-83fc-e44e8b1126b3 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:35.577688 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef5b97-0cbb-4cef-a41d-89da8a84e138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:35.578227 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5b97-0cbb-4cef-a41d-89da8a84e138 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:35.578512 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5b97-0cbb-4cef-a41d-89da8a84e138 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:35.578825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5b97-0cbb-4cef-a41d-89da8a84e138 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:35.579464 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef5b97-0cbb-4cef-a41d-89da8a84e138 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:35.580939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef5b97-0cbb-4cef-a41d-89da8a84e138 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:35.643099 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 27/57] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Aug 11 18:14:35 2022] POST /identity/v3/projects => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:14:37.821859 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da9e77-472a-46be-b334-a535c1e37f38 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:37.822355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da9e77-472a-46be-b334-a535c1e37f38 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:37.822463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da9e77-472a-46be-b334-a535c1e37f38 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:37.823815 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 31/58] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:37.828854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f5818-7066-4086-a9de-c91627a74014 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:37.829219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f5818-7066-4086-a9de-c91627a74014 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:37.829414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f5818-7066-4086-a9de-c91627a74014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:37.847439 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f25f5818-7066-4086-a9de-c91627a74014 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:37.848639 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f25f5818-7066-4086-a9de-c91627a74014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:37.917267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 28/59] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:38.245369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da9e77-472a-46be-b334-a535c1e37f38 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:38.291937 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:38.344578 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da9e77-472a-46be-b334-a535c1e37f38 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:38.376612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf808c3-04a3-426b-8e06-4a0411beb362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:38.377217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf808c3-04a3-426b-8e06-4a0411beb362 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:38.377496 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf808c3-04a3-426b-8e06-4a0411beb362 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:38.377767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf808c3-04a3-426b-8e06-4a0411beb362 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:38.378880 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf808c3-04a3-426b-8e06-4a0411beb362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:38.380425 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf808c3-04a3-426b-8e06-4a0411beb362 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:38.381949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 32/60] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:38.388329 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f5818-7066-4086-a9de-c91627a74014 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:38.399718 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:38.490720 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f5818-7066-4086-a9de-c91627a74014 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:38.528198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cf9b8-a1ef-4e90-a4db-c852e21fc18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:38.528736 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf9b8-a1ef-4e90-a4db-c852e21fc18b None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:38.529019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf9b8-a1ef-4e90-a4db-c852e21fc18b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:38.529315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf9b8-a1ef-4e90-a4db-c852e21fc18b None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:38.529954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf9b8-a1ef-4e90-a4db-c852e21fc18b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:38.531432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf9b8-a1ef-4e90-a4db-c852e21fc18b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:38.626209 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 29/61] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:14:38 2022] POST /identity/v3/users => generated 275 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:14:41.955123 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d744-fef6-49e9-b6fa-222be9859c33 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:41.956145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d744-fef6-49e9-b6fa-222be9859c33 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:41.956635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d744-fef6-49e9-b6fa-222be9859c33 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:41.958224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 33/62] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:41.963648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26069b-93b3-42b9-af12-3fd098f27992 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:41.964086 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26069b-93b3-42b9-af12-3fd098f27992 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:41.964201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26069b-93b3-42b9-af12-3fd098f27992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:41.992046 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1b26069b-93b3-42b9-af12-3fd098f27992 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:41.993583 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1b26069b-93b3-42b9-af12-3fd098f27992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:42.025575 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67f54-185e-4464-b4c5-02e18fbc92af None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:42.026093 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67f54-185e-4464-b4c5-02e18fbc92af None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:42.026433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67f54-185e-4464-b4c5-02e18fbc92af None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:42.032205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 34/63] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:42.033811 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298a030-2d31-4bf6-a13c-34b4a6437bc7 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:42.034249 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298a030-2d31-4bf6-a13c-34b4a6437bc7 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:42.034681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298a030-2d31-4bf6-a13c-34b4a6437bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:42.068938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:42.076218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-c298a030-2d31-4bf6-a13c-34b4a6437bc7 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:42.077461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 30/64] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:42.082798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-c298a030-2d31-4bf6-a13c-34b4a6437bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:42.195353 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 35/65] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:42.364695 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bf2fc-7281-4299-a494-718201c2c5a0 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:42.365386 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bf2fc-7281-4299-a494-718201c2c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:42.365866 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bf2fc-7281-4299-a494-718201c2c5a0 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:42.367645 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 31/66] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:42.372921 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471ea7-20cb-423f-a88e-170ffc635df4 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:42.373214 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471ea7-20cb-423f-a88e-170ffc635df4 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:42.373496 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471ea7-20cb-423f-a88e-170ffc635df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:42.403344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-d3471ea7-20cb-423f-a88e-170ffc635df4 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:42.404633 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-d3471ea7-20cb-423f-a88e-170ffc635df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:42.405094 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bf2fc-7281-4299-a494-718201c2c5a0 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:42.471002 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:42.534431 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 36/67] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:42.584433 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bf2fc-7281-4299-a494-718201c2c5a0 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:42.637801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20c861-a823-45e8-aa66-04b44e0aac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:42.638794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20c861-a823-45e8-aa66-04b44e0aac63 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:42.639300 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20c861-a823-45e8-aa66-04b44e0aac63 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:42.639794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20c861-a823-45e8-aa66-04b44e0aac63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:42.641443 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3471ea7-20cb-423f-a88e-170ffc635df4 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:42.653666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20c861-a823-45e8-aa66-04b44e0aac63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-6f20c861-a823-45e8-aa66-04b44e0aac63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:42.658954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:42.659803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:42.660571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:14:42.662946 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 32/68] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:14:42.669414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20c861-a823-45e8-aa66-04b44e0aac63 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:42.747254 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:42.774881 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3471ea7-20cb-423f-a88e-170ffc635df4 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:42.799839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20c861-a823-45e8-aa66-04b44e0aac63 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:42.814459 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bad54-ab5b-42de-a4e9-9b4f05aef038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:42.815598 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bad54-ab5b-42de-a4e9-9b4f05aef038 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:42.816051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bad54-ab5b-42de-a4e9-9b4f05aef038 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:42.816865 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bad54-ab5b-42de-a4e9-9b4f05aef038 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:42.830584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bad54-ab5b-42de-a4e9-9b4f05aef038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-6e9bad54-ab5b-42de-a4e9-9b4f05aef038 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:42.835646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:42.836590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:42.837515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:42.839247 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6363330-77c5-43c6-b6ed-7b4208d40e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:42.840033 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6363330-77c5-43c6-b6ed-7b4208d40e9a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:42.840389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6363330-77c5-43c6-b6ed-7b4208d40e9a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:42.840729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6363330-77c5-43c6-b6ed-7b4208d40e9a None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:42.841047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 37/69] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:14:42.841629 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6363330-77c5-43c6-b6ed-7b4208d40e9a None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:42.841997 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6363330-77c5-43c6-b6ed-7b4208d40e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:42.843488 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6363330-77c5-43c6-b6ed-7b4208d40e9a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:42.843687 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7286a-0c94-4401-9611-245c4813c58e None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:42.844160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7286a-0c94-4401-9611-245c4813c58e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:42.844612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7286a-0c94-4401-9611-245c4813c58e None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:42.846156 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 38/70] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:42.847125 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7286a-0c94-4401-9611-245c4813c58e None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:42.858328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 33/71] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:14:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:42.859789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc316f5-d6ea-4a4f-943b-2f9a4c53fb73 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:42.860251 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc316f5-d6ea-4a4f-943b-2f9a4c53fb73 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:42.860668 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc316f5-d6ea-4a4f-943b-2f9a4c53fb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:42.879845 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-8cc316f5-d6ea-4a4f-943b-2f9a4c53fb73 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:42.881036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-8cc316f5-d6ea-4a4f-943b-2f9a4c53fb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:42.882047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:42.950277 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 34/72] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:42.951305 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ce14-41da-43f2-8e26-fa6909bcb0b8 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:42.951595 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ce14-41da-43f2-8e26-fa6909bcb0b8 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:42.951874 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ce14-41da-43f2-8e26-fa6909bcb0b8 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:42.953092 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 35/73] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:42.953947 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ce14-41da-43f2-8e26-fa6909bcb0b8 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:42.960250 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7286a-0c94-4401-9611-245c4813c58e None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:42.999636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79be6d-5ef9-46a7-9def-9df33752eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:43.000389 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79be6d-5ef9-46a7-9def-9df33752eee4 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.000683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79be6d-5ef9-46a7-9def-9df33752eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.000961 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79be6d-5ef9-46a7-9def-9df33752eee4 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.001629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79be6d-5ef9-46a7-9def-9df33752eee4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:43.001940 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79be6d-5ef9-46a7-9def-9df33752eee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:43.003386 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79be6d-5ef9-46a7-9def-9df33752eee4 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:43.012788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 39/74] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:43.013509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79be6d-5ef9-46a7-9def-9df33752eee4 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:43.019591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:43.075973 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ce14-41da-43f2-8e26-fa6909bcb0b8 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:43.111478 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7196-7260-4b8d-aef6-38bb9e224678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:43.112104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7196-7260-4b8d-aef6-38bb9e224678 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.112392 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7196-7260-4b8d-aef6-38bb9e224678 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.112667 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7196-7260-4b8d-aef6-38bb9e224678 None admin] PATH_INFO: `/v3/users/c790b85dd5ed4c03b864ddd177ed5e03` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.120587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:43.127245 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b7196-7260-4b8d-aef6-38bb9e224678 None admin] RBAC: Authorizing `identity:get_user(user_id=c790b85dd5ed4c03b864ddd177ed5e03)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:43.127924 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79be6d-5ef9-46a7-9def-9df33752eee4 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:43.128727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b7196-7260-4b8d-aef6-38bb9e224678 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:43.130613 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 36/75] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:42 2022] GET /identity/v3/users/c790b85dd5ed4c03b864ddd177ed5e03 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:43.131544 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e6bc-57e8-4c78-94c6-e88a6b7dd498 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.131832 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e6bc-57e8-4c78-94c6-e88a6b7dd498 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.132108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e6bc-57e8-4c78-94c6-e88a6b7dd498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.153125 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-51b0e6bc-57e8-4c78-94c6-e88a6b7dd498 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:43.155078 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-51b0e6bc-57e8-4c78-94c6-e88a6b7dd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:43.168146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760a384-f0f4-403b-bf32-2e86d005196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:43.168775 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760a384-f0f4-403b-bf32-2e86d005196a None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.169055 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760a384-f0f4-403b-bf32-2e86d005196a None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.169329 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760a384-f0f4-403b-bf32-2e86d005196a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.179523 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760a384-f0f4-403b-bf32-2e86d005196a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-a760a384-f0f4-403b-bf32-2e86d005196a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:43.185931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:43.186839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:43.187607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 40/76] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:14:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:43.188375 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760a384-f0f4-403b-bf32-2e86d005196a None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:43.246988 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 37/77] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:43.248378 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0e6bc-57e8-4c78-94c6-e88a6b7dd498 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:43.295885 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:43.296060 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760a384-f0f4-403b-bf32-2e86d005196a None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:43.332091 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69622e1f-66bd-46fc-98aa-a8e4b361b08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:43.332873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69622e1f-66bd-46fc-98aa-a8e4b361b08d None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.333895 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69622e1f-66bd-46fc-98aa-a8e4b361b08d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.334183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69622e1f-66bd-46fc-98aa-a8e4b361b08d None admin] PATH_INFO: `/v3/users/88fec54a2c514363b52e38552e10c343` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.335343 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69622e1f-66bd-46fc-98aa-a8e4b361b08d None admin] RBAC: Authorizing `identity:get_user(user_id=88fec54a2c514363b52e38552e10c343)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:43.336790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69622e1f-66bd-46fc-98aa-a8e4b361b08d None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:43.339283 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 41/78] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:43 2022] GET /identity/v3/users/88fec54a2c514363b52e38552e10c343 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:43.339862 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69622e1f-66bd-46fc-98aa-a8e4b361b08d None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:43.365665 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:43.368508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0e6bc-57e8-4c78-94c6-e88a6b7dd498 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:43.407546 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028b337-a199-44f3-a7f7-2caa027dd2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:43.408150 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028b337-a199-44f3-a7f7-2caa027dd2e1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.408431 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028b337-a199-44f3-a7f7-2caa027dd2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.408699 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028b337-a199-44f3-a7f7-2caa027dd2e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.452235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69622e1f-66bd-46fc-98aa-a8e4b361b08d None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:43.481539 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028b337-a199-44f3-a7f7-2caa027dd2e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:43.483197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028b337-a199-44f3-a7f7-2caa027dd2e1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:43.487853 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fb72d-03e5-4e74-86ac-ab89a1f6ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:43.488453 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb72d-03e5-4e74-86ac-ab89a1f6ce7d None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.488735 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb72d-03e5-4e74-86ac-ab89a1f6ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.489009 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb72d-03e5-4e74-86ac-ab89a1f6ce7d None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.489719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fb72d-03e5-4e74-86ac-ab89a1f6ce7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:43.490027 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fb72d-03e5-4e74-86ac-ab89a1f6ce7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:43.491409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fb72d-03e5-4e74-86ac-ab89a1f6ce7d None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:43.504835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 42/79] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:14:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:43.504835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fb72d-03e5-4e74-86ac-ab89a1f6ce7d None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:43.527543 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:43.590963 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:43.597330 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 38/80] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:14:43.598392 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028b337-a199-44f3-a7f7-2caa027dd2e1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:43.610397 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fb72d-03e5-4e74-86ac-ab89a1f6ce7d None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:43.644690 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa759c81-6b1e-4d57-b569-11ec3f7fe5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:43.645312 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759c81-6b1e-4d57-b569-11ec3f7fe5bc None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.645602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759c81-6b1e-4d57-b569-11ec3f7fe5bc None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.645873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa759c81-6b1e-4d57-b569-11ec3f7fe5bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.656620 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa759c81-6b1e-4d57-b569-11ec3f7fe5bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-fa759c81-6b1e-4d57-b569-11ec3f7fe5bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:43.662136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:43.663010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:43.663783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 43/81] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:43.664426 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa759c81-6b1e-4d57-b569-11ec3f7fe5bc None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:43.700017 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028b337-a199-44f3-a7f7-2caa027dd2e1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:43.735367 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e48799-bfde-4007-b790-6291a4b82d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:43.735984 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e48799-bfde-4007-b790-6291a4b82d9c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.736273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e48799-bfde-4007-b790-6291a4b82d9c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.736556 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e48799-bfde-4007-b790-6291a4b82d9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.740493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:43.767385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa759c81-6b1e-4d57-b569-11ec3f7fe5bc None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:43.800130 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c811a1-0bee-44ca-a5e1-0fe37d4c521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:43.800755 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c811a1-0bee-44ca-a5e1-0fe37d4c521c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.801041 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c811a1-0bee-44ca-a5e1-0fe37d4c521c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.801321 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c811a1-0bee-44ca-a5e1-0fe37d4c521c None admin] PATH_INFO: `/v3/users/c790b85dd5ed4c03b864ddd177ed5e03` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.802462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c811a1-0bee-44ca-a5e1-0fe37d4c521c None admin] RBAC: Authorizing `identity:get_user(user_id=c790b85dd5ed4c03b864ddd177ed5e03)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:43.803970 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c811a1-0bee-44ca-a5e1-0fe37d4c521c None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:43.804837 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e48799-bfde-4007-b790-6291a4b82d9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:43.805550 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 44/82] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:43 2022] GET /identity/v3/users/c790b85dd5ed4c03b864ddd177ed5e03 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:43.806839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c811a1-0bee-44ca-a5e1-0fe37d4c521c None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:43.807167 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e48799-bfde-4007-b790-6291a4b82d9c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:43.821523 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:43.903865 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 39/83] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:14:43.904722 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e48799-bfde-4007-b790-6291a4b82d9c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:43.907285 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c811a1-0bee-44ca-a5e1-0fe37d4c521c None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:43.941609 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:43.942734 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bc593-e5cb-43d3-bf61-780197cee6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:43.943364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bc593-e5cb-43d3-bf61-780197cee6dd None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:43.943707 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bc593-e5cb-43d3-bf61-780197cee6dd None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:43.943989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bc593-e5cb-43d3-bf61-780197cee6dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:43.945111 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bc593-e5cb-43d3-bf61-780197cee6dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:43.946548 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bc593-e5cb-43d3-bf61-780197cee6dd None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:43.948738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 45/84] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:43.949514 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bc593-e5cb-43d3-bf61-780197cee6dd None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:44.006576 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e48799-bfde-4007-b790-6291a4b82d9c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:44.031906 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:44.040468 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f86595-5003-4576-adec-042fda07de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:44.041215 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f86595-5003-4576-adec-042fda07de5d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:44.041494 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f86595-5003-4576-adec-042fda07de5d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:44.041768 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f86595-5003-4576-adec-042fda07de5d None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:44.044630 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f86595-5003-4576-adec-042fda07de5d None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:44.044630 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f86595-5003-4576-adec-042fda07de5d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:44.046043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 40/85] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:43 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:44.046834 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f86595-5003-4576-adec-042fda07de5d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:44.052181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bc593-e5cb-43d3-bf61-780197cee6dd None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:44.086852 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0095c8-2dbe-4b5c-8dd7-97d7463b8167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:44.087482 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0095c8-2dbe-4b5c-8dd7-97d7463b8167 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:44.087788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0095c8-2dbe-4b5c-8dd7-97d7463b8167 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:44.088055 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0095c8-2dbe-4b5c-8dd7-97d7463b8167 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:44.088719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0095c8-2dbe-4b5c-8dd7-97d7463b8167 None admin] RBAC: Adding query filter params (name=member) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:44.089024 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0095c8-2dbe-4b5c-8dd7-97d7463b8167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:44.090410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0095c8-2dbe-4b5c-8dd7-97d7463b8167 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:44.103641 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 46/86] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:44.103641 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0095c8-2dbe-4b5c-8dd7-97d7463b8167 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:44.151291 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f86595-5003-4576-adec-042fda07de5d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:44.153571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:44.186439 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d521a1d-1e07-4054-87fe-391ee6376468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:44.187074 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d521a1d-1e07-4054-87fe-391ee6376468 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:44.187363 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d521a1d-1e07-4054-87fe-391ee6376468 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:44.187714 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d521a1d-1e07-4054-87fe-391ee6376468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:44.199358 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0095c8-2dbe-4b5c-8dd7-97d7463b8167 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:44.232348 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd720f-27d4-4ca5-8c26-bf9016a1f513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:44.232999 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd720f-27d4-4ca5-8c26-bf9016a1f513 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:44.233290 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd720f-27d4-4ca5-8c26-bf9016a1f513 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:44.233565 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd720f-27d4-4ca5-8c26-bf9016a1f513 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:44.234705 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd720f-27d4-4ca5-8c26-bf9016a1f513 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:44.236145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd720f-27d4-4ca5-8c26-bf9016a1f513 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:44.238103 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 47/87] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:44 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:44.238520 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd720f-27d4-4ca5-8c26-bf9016a1f513 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:44.252558 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:44.255809 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d521a1d-1e07-4054-87fe-391ee6376468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:44.257290 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d521a1d-1e07-4054-87fe-391ee6376468 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:44.339624 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd720f-27d4-4ca5-8c26-bf9016a1f513 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:44.355250 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 41/88] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:14:44.360585 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d521a1d-1e07-4054-87fe-391ee6376468 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:44.363685 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:44.374344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650076b-0472-4afc-979b-cc27a9bf5746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:44.374976 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650076b-0472-4afc-979b-cc27a9bf5746 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:44.375260 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650076b-0472-4afc-979b-cc27a9bf5746 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:44.375591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650076b-0472-4afc-979b-cc27a9bf5746 None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:44.376231 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650076b-0472-4afc-979b-cc27a9bf5746 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:44.377737 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650076b-0472-4afc-979b-cc27a9bf5746 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:44.458765 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d521a1d-1e07-4054-87fe-391ee6376468 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:44.469744 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 48/89] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:14:44 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:14:44.469744 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650076b-0472-4afc-979b-cc27a9bf5746 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:44.499471 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4ae32-022f-43d1-bda5-cb81046147a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:44.500118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ae32-022f-43d1-bda5-cb81046147a6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:44.500409 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ae32-022f-43d1-bda5-cb81046147a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:44.500690 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ae32-022f-43d1-bda5-cb81046147a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:44.501450 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4ae32-022f-43d1-bda5-cb81046147a6 None admin] RBAC: Adding query filter params (role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2, user.id=c790b85dd5ed4c03b864ddd177ed5e03) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:44.501768 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4ae32-022f-43d1-bda5-cb81046147a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:44.503437 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4ae32-022f-43d1-bda5-cb81046147a6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:44.511116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 42/90] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:14:44 2022] GET /identity/v3/role_assignments?user.id=c790b85dd5ed4c03b864ddd177ed5e03&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:44.512027 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4ae32-022f-43d1-bda5-cb81046147a6 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:44.564456 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:44.612765 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650076b-0472-4afc-979b-cc27a9bf5746 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:44.626418 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:44.667894 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4ae32-022f-43d1-bda5-cb81046147a6 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:44.678073 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c57566-c074-4490-a4cd-b858b8a0c76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:44.679438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57566-c074-4490-a4cd-b858b8a0c76e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:44.679704 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57566-c074-4490-a4cd-b858b8a0c76e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:44.679979 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57566-c074-4490-a4cd-b858b8a0c76e None admin] PATH_INFO: `/v3/users/c790b85dd5ed4c03b864ddd177ed5e03` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:44.682201 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c57566-c074-4490-a4cd-b858b8a0c76e None admin] RBAC: Authorizing `identity:get_user(user_id=c790b85dd5ed4c03b864ddd177ed5e03)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:44.685606 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c57566-c074-4490-a4cd-b858b8a0c76e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:44.687969 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 49/91] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:44 2022] GET /identity/v3/users/c790b85dd5ed4c03b864ddd177ed5e03 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:44.688876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c57566-c074-4490-a4cd-b858b8a0c76e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:44.724137 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee293ec-ebd2-4c5f-bf21-2ab1b72f2ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:44.725037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee293ec-ebd2-4c5f-bf21-2ab1b72f2ca3 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:44.725332 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee293ec-ebd2-4c5f-bf21-2ab1b72f2ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:44.725611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee293ec-ebd2-4c5f-bf21-2ab1b72f2ca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:44.726348 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee293ec-ebd2-4c5f-bf21-2ab1b72f2ca3 None admin] RBAC: Adding query filter params (role.id=f89efd1f713043d8835c127de30f53ca, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2, user.id=88fec54a2c514363b52e38552e10c343) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:44.726924 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee293ec-ebd2-4c5f-bf21-2ab1b72f2ca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:44.729071 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee293ec-ebd2-4c5f-bf21-2ab1b72f2ca3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:44.742184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 43/92] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:14:44 2022] GET /identity/v3/role_assignments?user.id=88fec54a2c514363b52e38552e10c343&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=f89efd1f713043d8835c127de30f53ca => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:44.742519 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee293ec-ebd2-4c5f-bf21-2ab1b72f2ca3 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:44.825898 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c57566-c074-4490-a4cd-b858b8a0c76e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:44.864921 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee293ec-ebd2-4c5f-bf21-2ab1b72f2ca3 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:44.869716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c18f7b-a5f0-463f-bf01-fbb4de202e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:44.870779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c18f7b-a5f0-463f-bf01-fbb4de202e71 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:44.871332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c18f7b-a5f0-463f-bf01-fbb4de202e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:44.871834 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c18f7b-a5f0-463f-bf01-fbb4de202e71 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:44.873419 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c18f7b-a5f0-463f-bf01-fbb4de202e71 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:44.875505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c18f7b-a5f0-463f-bf01-fbb4de202e71 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:44.877488 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 50/93] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:44 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:44.883578 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c18f7b-a5f0-463f-bf01-fbb4de202e71 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:44.889012 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:44.939410 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:44.946437 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fd7f1-8558-42d6-a65b-1ae550153c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:44.949508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fd7f1-8558-42d6-a65b-1ae550153c69 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:44.949508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fd7f1-8558-42d6-a65b-1ae550153c69 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:44.949508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fd7f1-8558-42d6-a65b-1ae550153c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:45.025509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c18f7b-a5f0-463f-bf01-fbb4de202e71 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:45.060954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fd7f1-8558-42d6-a65b-1ae550153c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:45.063977 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fd7f1-8558-42d6-a65b-1ae550153c69 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:45.070520 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2af95-2e9b-490d-95d5-0e10a985f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:45.071299 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2af95-2e9b-490d-95d5-0e10a985f11e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:45.071659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2af95-2e9b-490d-95d5-0e10a985f11e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:45.072049 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2af95-2e9b-490d-95d5-0e10a985f11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:45.072928 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2af95-2e9b-490d-95d5-0e10a985f11e None admin] RBAC: Adding query filter params (role.id=75e4b5f3154e45059ce3a6449ac4ba3e, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2, user.id=c790b85dd5ed4c03b864ddd177ed5e03) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:45.073350 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2af95-2e9b-490d-95d5-0e10a985f11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:45.075091 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2af95-2e9b-490d-95d5-0e10a985f11e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:45.083203 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 51/94] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:14:44 2022] GET /identity/v3/role_assignments?user.id=c790b85dd5ed4c03b864ddd177ed5e03&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=75e4b5f3154e45059ce3a6449ac4ba3e => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:45.192141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 44/95] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:14:45.198845 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2af95-2e9b-490d-95d5-0e10a985f11e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:45.294455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:45.339704 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2af95-2e9b-490d-95d5-0e10a985f11e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:45.380890 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8804cc-e26a-4f07-842f-0d49a6d30f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:45.381859 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8804cc-e26a-4f07-842f-0d49a6d30f3b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:45.382378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8804cc-e26a-4f07-842f-0d49a6d30f3b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:45.382942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8804cc-e26a-4f07-842f-0d49a6d30f3b None admin] PATH_INFO: `/v3/projects/c975759c5815431497a0cdb9170454c3` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:45.387380 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8804cc-e26a-4f07-842f-0d49a6d30f3b None admin] RBAC: Authorizing `identity:get_project(project_id=c975759c5815431497a0cdb9170454c3)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:45.389030 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8804cc-e26a-4f07-842f-0d49a6d30f3b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:45.390889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 52/96] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:45 2022] GET /identity/v3/projects/c975759c5815431497a0cdb9170454c3 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:45.397001 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fd7f1-8558-42d6-a65b-1ae550153c69 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:45.438994 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:45.528360 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fd7f1-8558-42d6-a65b-1ae550153c69 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:45.582183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b54a7-a1eb-413c-94f2-97a0767795db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:45.582827 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b54a7-a1eb-413c-94f2-97a0767795db None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:45.583116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b54a7-a1eb-413c-94f2-97a0767795db None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:45.583395 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b54a7-a1eb-413c-94f2-97a0767795db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:45.584128 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b54a7-a1eb-413c-94f2-97a0767795db None admin] RBAC: Adding query filter params (role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, scope.project.id=c975759c5815431497a0cdb9170454c3, user.id=c790b85dd5ed4c03b864ddd177ed5e03) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:45.584443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b54a7-a1eb-413c-94f2-97a0767795db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:45.585912 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b54a7-a1eb-413c-94f2-97a0767795db None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:45.592077 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 45/97] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:14:45 2022] GET /identity/v3/role_assignments?user.id=c790b85dd5ed4c03b864ddd177ed5e03&scope.project.id=c975759c5815431497a0cdb9170454c3&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:47.263536 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ef54-3dbe-4f77-b6de-81becea97b6a None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:47.264042 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ef54-3dbe-4f77-b6de-81becea97b6a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:47.264114 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275ef54-3dbe-4f77-b6de-81becea97b6a None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:47.265421 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 53/98] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:47.271000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9bed3-102b-42c9-a335-8198f4b85992 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:47.271384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9bed3-102b-42c9-a335-8198f4b85992 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:47.271561 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9bed3-102b-42c9-a335-8198f4b85992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:47.289956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-25c9bed3-102b-42c9-a335-8198f4b85992 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:47.291690 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-25c9bed3-102b-42c9-a335-8198f4b85992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:47.392928 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 46/99] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:47.865381 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c45d0-45c4-468e-bf7d-29abf036f863 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:47.865743 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c45d0-45c4-468e-bf7d-29abf036f863 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:47.865961 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c45d0-45c4-468e-bf7d-29abf036f863 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:47.867504 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 54/100] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:47.873442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45f14-b0ea-424c-b079-0942f8659014 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:47.873741 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45f14-b0ea-424c-b079-0942f8659014 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:47.874387 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45f14-b0ea-424c-b079-0942f8659014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:47.898936 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-92e45f14-b0ea-424c-b079-0942f8659014 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:47.904942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-92e45f14-b0ea-424c-b079-0942f8659014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:47.923457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:47.968391 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c45d0-45c4-468e-bf7d-29abf036f863 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:47.973860 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 47/101] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:47.984801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022249db-8fe9-45d6-ad4f-1a0d0853078a None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:47.987072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022249db-8fe9-45d6-ad4f-1a0d0853078a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:47.987528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022249db-8fe9-45d6-ad4f-1a0d0853078a None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:47.992082 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 48/102] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:47.996957 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb4510-0f37-408a-808c-2533c824b068 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:47.997439 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb4510-0f37-408a-808c-2533c824b068 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:47.997884 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb4510-0f37-408a-808c-2533c824b068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:48.032262 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-40cb4510-0f37-408a-808c-2533c824b068 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:48.034437 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-40cb4510-0f37-408a-808c-2533c824b068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:48.131206 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c45d0-45c4-468e-bf7d-29abf036f863 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:48.153737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 49/103] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:48.173417 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f4a5a-bcaa-4834-80a2-c2bb41f190e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:48.174499 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f4a5a-bcaa-4834-80a2-c2bb41f190e8 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:48.174976 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f4a5a-bcaa-4834-80a2-c2bb41f190e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:48.175426 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f4a5a-bcaa-4834-80a2-c2bb41f190e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:48.186829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f4a5a-bcaa-4834-80a2-c2bb41f190e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:48.191694 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-6a5f4a5a-bcaa-4834-80a2-c2bb41f190e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:48.192989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:48.193814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:48.194592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:48.197452 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 55/104] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:14:48.203358 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb4510-0f37-408a-808c-2533c824b068 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:48.329664 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:48.350420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb4510-0f37-408a-808c-2533c824b068 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:48.399528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec7daf-8503-46e4-8dbf-c8557ca4f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:48.400198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec7daf-8503-46e4-8dbf-c8557ca4f18a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:48.400489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec7daf-8503-46e4-8dbf-c8557ca4f18a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:48.400807 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec7daf-8503-46e4-8dbf-c8557ca4f18a None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:48.401553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec7daf-8503-46e4-8dbf-c8557ca4f18a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:48.401863 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec7daf-8503-46e4-8dbf-c8557ca4f18a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:48.403285 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec7daf-8503-46e4-8dbf-c8557ca4f18a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:48.418078 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 50/105] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:48.423585 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f4a5a-bcaa-4834-80a2-c2bb41f190e8 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:48.490277 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec7daf-8503-46e4-8dbf-c8557ca4f18a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:48.629645 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f4a5a-bcaa-4834-80a2-c2bb41f190e8 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:48.682414 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db275c-5750-43f0-b909-7f956c0f5d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:48.683097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db275c-5750-43f0-b909-7f956c0f5d81 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:48.683378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db275c-5750-43f0-b909-7f956c0f5d81 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:48.683650 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db275c-5750-43f0-b909-7f956c0f5d81 None admin] PATH_INFO: `/v3/users/88fec54a2c514363b52e38552e10c343` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:48.685245 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db275c-5750-43f0-b909-7f956c0f5d81 None admin] RBAC: Authorizing `identity:get_user(user_id=88fec54a2c514363b52e38552e10c343)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:48.686758 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db275c-5750-43f0-b909-7f956c0f5d81 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:48.688448 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 56/106] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:48 2022] GET /identity/v3/users/88fec54a2c514363b52e38552e10c343 => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:48.689269 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db275c-5750-43f0-b909-7f956c0f5d81 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:48.752048 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec7daf-8503-46e4-8dbf-c8557ca4f18a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:48.766424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:48.791656 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76ae67-3fb4-4b28-9f9b-bc65a75a47de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:48.792324 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ae67-3fb4-4b28-9f9b-bc65a75a47de None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:48.792611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ae67-3fb4-4b28-9f9b-bc65a75a47de None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:48.792893 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ae67-3fb4-4b28-9f9b-bc65a75a47de None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:48.805356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76ae67-3fb4-4b28-9f9b-bc65a75a47de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:48.806120 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db275c-5750-43f0-b909-7f956c0f5d81 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-2c76ae67-3fb4-4b28-9f9b-bc65a75a47de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:48.812489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:48.813372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:14:48.814169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 51/107] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:48.814861 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76ae67-3fb4-4b28-9f9b-bc65a75a47de None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:48.828486 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:48.843215 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b8240-f732-4873-a133-00b6395a5d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:48.844001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8240-f732-4873-a133-00b6395a5d88 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:48.849700 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8240-f732-4873-a133-00b6395a5d88 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:48.849700 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8240-f732-4873-a133-00b6395a5d88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:48.856986 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b8240-f732-4873-a133-00b6395a5d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-d74b8240-f732-4873-a133-00b6395a5d88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:48.862619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:48.864225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:48.865833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 57/108] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:48.871921 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219fc2f-dfde-4bc9-aca3-ddcee9ee75c1 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:48.872256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219fc2f-dfde-4bc9-aca3-ddcee9ee75c1 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:48.872600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219fc2f-dfde-4bc9-aca3-ddcee9ee75c1 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:48.874033 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 58/109] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:48.875133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219fc2f-dfde-4bc9-aca3-ddcee9ee75c1 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:48.936645 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76ae67-3fb4-4b28-9f9b-bc65a75a47de None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:48.973947 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54213ff-deaf-4c38-9f7c-633daef03f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:48.974588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54213ff-deaf-4c38-9f7c-633daef03f07 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:48.974917 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54213ff-deaf-4c38-9f7c-633daef03f07 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:48.975195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54213ff-deaf-4c38-9f7c-633daef03f07 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:48.976545 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54213ff-deaf-4c38-9f7c-633daef03f07 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:48.978007 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54213ff-deaf-4c38-9f7c-633daef03f07 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:48.980936 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 52/110] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:48 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:48.983306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219fc2f-dfde-4bc9-aca3-ddcee9ee75c1 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:48.986624 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54213ff-deaf-4c38-9f7c-633daef03f07 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:49.006317 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:49.018074 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084deda-d6bc-4139-91d3-722ab9586500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:49.018708 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084deda-d6bc-4139-91d3-722ab9586500 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.019000 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084deda-d6bc-4139-91d3-722ab9586500 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.019462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084deda-d6bc-4139-91d3-722ab9586500 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.019943 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084deda-d6bc-4139-91d3-722ab9586500 None admin] RBAC: Adding query filter params (name=member) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:49.020247 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084deda-d6bc-4139-91d3-722ab9586500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:49.021640 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084deda-d6bc-4139-91d3-722ab9586500 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:49.030936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 59/111] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:14:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:49.033703 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b301d-8d62-4d6a-aa20-17634d97b95c None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.033703 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b301d-8d62-4d6a-aa20-17634d97b95c None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.033703 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b301d-8d62-4d6a-aa20-17634d97b95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.050824 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-886b301d-8d62-4d6a-aa20-17634d97b95c None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:49.052086 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-886b301d-8d62-4d6a-aa20-17634d97b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:49.069644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:49.092544 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54213ff-deaf-4c38-9f7c-633daef03f07 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:49.121919 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 60/112] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:49.123205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399747a-b164-4225-b7d2-a1ad8a5234a1 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.123498 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399747a-b164-4225-b7d2-a1ad8a5234a1 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.123770 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399747a-b164-4225-b7d2-a1ad8a5234a1 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.125415 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 61/113] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:49.125926 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399747a-b164-4225-b7d2-a1ad8a5234a1 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:49.136368 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba89b97-49c3-4def-a184-3040cdca78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:49.139605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba89b97-49c3-4def-a184-3040cdca78fc None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.139605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba89b97-49c3-4def-a184-3040cdca78fc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.139605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba89b97-49c3-4def-a184-3040cdca78fc None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.139605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba89b97-49c3-4def-a184-3040cdca78fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:49.139605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba89b97-49c3-4def-a184-3040cdca78fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:49.140227 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba89b97-49c3-4def-a184-3040cdca78fc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:49.149120 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 53/114] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:14:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:49.150847 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dd8c3-81d2-4224-bdca-1dcf3ce7277a None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.151261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dd8c3-81d2-4224-bdca-1dcf3ce7277a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.151543 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dd8c3-81d2-4224-bdca-1dcf3ce7277a None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.152983 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 54/115] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:49.153590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dd8c3-81d2-4224-bdca-1dcf3ce7277a None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:49.249011 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399747a-b164-4225-b7d2-a1ad8a5234a1 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:49.265301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:49.269128 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dd8c3-81d2-4224-bdca-1dcf3ce7277a None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:49.285664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e79475-63f7-48a1-a7c3-d0c1d923155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:49.286427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e79475-63f7-48a1-a7c3-d0c1d923155e None admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.286737 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e79475-63f7-48a1-a7c3-d0c1d923155e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.287129 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e79475-63f7-48a1-a7c3-d0c1d923155e None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/users/88fec54a2c514363b52e38552e10c343/roles/f89efd1f713043d8835c127de30f53ca` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.289082 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e79475-63f7-48a1-a7c3-d0c1d923155e None admin] RBAC: Authorizing `identity:create_grant(project_id=acffc2592e8c40299db4c5bf775f0ca2, user_id=88fec54a2c514363b52e38552e10c343, role_id=f89efd1f713043d8835c127de30f53ca)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:49.290705 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e79475-63f7-48a1-a7c3-d0c1d923155e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:49.303734 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d3539-686a-489e-8183-30ffc0f190a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:49.304356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d3539-686a-489e-8183-30ffc0f190a3 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.304635 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d3539-686a-489e-8183-30ffc0f190a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.304905 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d3539-686a-489e-8183-30ffc0f190a3 None admin] PATH_INFO: `/v3/users/c790b85dd5ed4c03b864ddd177ed5e03` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.306027 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d3539-686a-489e-8183-30ffc0f190a3 None admin] RBAC: Authorizing `identity:get_user(user_id=c790b85dd5ed4c03b864ddd177ed5e03)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:49.308018 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d3539-686a-489e-8183-30ffc0f190a3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:49.309581 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 55/116] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:49 2022] GET /identity/v3/users/c790b85dd5ed4c03b864ddd177ed5e03 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:49.310691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb6688-825b-4a18-bb11-2746b8d4e41f None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.311051 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb6688-825b-4a18-bb11-2746b8d4e41f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.311319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb6688-825b-4a18-bb11-2746b8d4e41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.324501 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:49.329851 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-0ddb6688-825b-4a18-bb11-2746b8d4e41f None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:49.331069 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-0ddb6688-825b-4a18-bb11-2746b8d4e41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:49.370079 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 62/117] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:14:49 2022] PUT /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/users/88fec54a2c514363b52e38552e10c343/roles/f89efd1f713043d8835c127de30f53ca => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:14:49.371169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e79475-63f7-48a1-a7c3-d0c1d923155e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:49.417920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 56/118] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:49.419471 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaee06-455b-4c28-96b0-32a7c373528b None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.419762 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaee06-455b-4c28-96b0-32a7c373528b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.420041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaee06-455b-4c28-96b0-32a7c373528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.439770 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-93eaee06-455b-4c28-96b0-32a7c373528b None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:49.440981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-93eaee06-455b-4c28-96b0-32a7c373528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:49.516252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e79475-63f7-48a1-a7c3-d0c1d923155e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:49.537133 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 57/119] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:49.546824 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaee06-455b-4c28-96b0-32a7c373528b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:49.570837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857af7e7-d537-48e1-8097-42dbb484c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:49.571551 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af7e7-d537-48e1-8097-42dbb484c665 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.571835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af7e7-d537-48e1-8097-42dbb484c665 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.572275 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af7e7-d537-48e1-8097-42dbb484c665 None admin] PATH_INFO: `/v3/users/03b353fdc14c46b6a00baec1574f2ebf` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.593062 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857af7e7-d537-48e1-8097-42dbb484c665 None admin] RBAC: Authorizing `identity:get_user(user_id=03b353fdc14c46b6a00baec1574f2ebf)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:49.594535 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857af7e7-d537-48e1-8097-42dbb484c665 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:49.596455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 63/120] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:49 2022] GET /identity/v3/users/03b353fdc14c46b6a00baec1574f2ebf => generated 289 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:49.597024 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857af7e7-d537-48e1-8097-42dbb484c665 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:49.638189 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:49.650103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:49.691531 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaee06-455b-4c28-96b0-32a7c373528b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:49.726301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857af7e7-d537-48e1-8097-42dbb484c665 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:49.730378 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb883-61a1-4a4c-8c04-cb2877c02ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:49.731061 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb883-61a1-4a4c-8c04-cb2877c02ae4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.731344 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb883-61a1-4a4c-8c04-cb2877c02ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.731616 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb883-61a1-4a4c-8c04-cb2877c02ae4 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.732773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edb883-61a1-4a4c-8c04-cb2877c02ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:49.734226 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edb883-61a1-4a4c-8c04-cb2877c02ae4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:49.736384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 58/121] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:49 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:49.737182 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb883-61a1-4a4c-8c04-cb2877c02ae4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:49.795322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837000b-2302-498c-b0fc-65fa6ba27c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:49.795886 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837000b-2302-498c-b0fc-65fa6ba27c6e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.796169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837000b-2302-498c-b0fc-65fa6ba27c6e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.796445 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837000b-2302-498c-b0fc-65fa6ba27c6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.815409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837000b-2302-498c-b0fc-65fa6ba27c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-b837000b-2302-498c-b0fc-65fa6ba27c6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:49.820454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:49.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:49.823169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 64/122] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:14:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:49.827554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837000b-2302-498c-b0fc-65fa6ba27c6e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:49.855229 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb883-61a1-4a4c-8c04-cb2877c02ae4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:49.893257 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2827ec-5822-48e8-8326-0ca9660f2e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:49.893869 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2827ec-5822-48e8-8326-0ca9660f2e3b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:49.894154 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2827ec-5822-48e8-8326-0ca9660f2e3b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:49.894434 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2827ec-5822-48e8-8326-0ca9660f2e3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:49.897158 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:49.953904 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:49.963460 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837000b-2302-498c-b0fc-65fa6ba27c6e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:49.969124 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2827ec-5822-48e8-8326-0ca9660f2e3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:49.970590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2827ec-5822-48e8-8326-0ca9660f2e3b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:50.008085 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86decba-60e8-4625-95c2-bf8e24fb730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:50.008751 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86decba-60e8-4625-95c2-bf8e24fb730f None admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:50.009030 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86decba-60e8-4625-95c2-bf8e24fb730f None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:50.009402 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86decba-60e8-4625-95c2-bf8e24fb730f None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/users/c790b85dd5ed4c03b864ddd177ed5e03/roles/1e94f00bf0f044b89bc9bd8dab18e2fa` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:50.012097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86decba-60e8-4625-95c2-bf8e24fb730f None admin] RBAC: Authorizing `identity:create_grant(project_id=acffc2592e8c40299db4c5bf775f0ca2, user_id=c790b85dd5ed4c03b864ddd177ed5e03, role_id=1e94f00bf0f044b89bc9bd8dab18e2fa)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:50.013536 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86decba-60e8-4625-95c2-bf8e24fb730f None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:50.079028 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 59/123] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:14:50.079823 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2827ec-5822-48e8-8326-0ca9660f2e3b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:50.120153 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:50.123482 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 65/124] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:14:49 2022] PUT /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/users/c790b85dd5ed4c03b864ddd177ed5e03/roles/1e94f00bf0f044b89bc9bd8dab18e2fa => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:14:50.124783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86decba-60e8-4625-95c2-bf8e24fb730f None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:50.224068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2827ec-5822-48e8-8326-0ca9660f2e3b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:50.274519 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86decba-60e8-4625-95c2-bf8e24fb730f None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:50.284943 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9473552-6953-4d7c-b2b1-81bef79dc8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:50.285798 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473552-6953-4d7c-b2b1-81bef79dc8a9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:50.286907 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473552-6953-4d7c-b2b1-81bef79dc8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:50.287217 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473552-6953-4d7c-b2b1-81bef79dc8a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:50.287923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9473552-6953-4d7c-b2b1-81bef79dc8a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:50.288237 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9473552-6953-4d7c-b2b1-81bef79dc8a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:50.289654 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9473552-6953-4d7c-b2b1-81bef79dc8a9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:50.301387 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 60/125] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:14:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:50.308213 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9473552-6953-4d7c-b2b1-81bef79dc8a9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:50.329859 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab028a83-35ec-49be-b07d-e82c3a82aae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:50.330965 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab028a83-35ec-49be-b07d-e82c3a82aae8 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:50.331504 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab028a83-35ec-49be-b07d-e82c3a82aae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:50.331999 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab028a83-35ec-49be-b07d-e82c3a82aae8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:50.333397 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab028a83-35ec-49be-b07d-e82c3a82aae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:50.335189 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab028a83-35ec-49be-b07d-e82c3a82aae8 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:50.338273 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 66/126] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:50.339472 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab028a83-35ec-49be-b07d-e82c3a82aae8 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:50.373157 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:50.450683 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:50.456950 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9473552-6953-4d7c-b2b1-81bef79dc8a9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:50.469559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab028a83-35ec-49be-b07d-e82c3a82aae8 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:50.498650 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8eaa5-8ce2-401a-8b95-61fb81f1c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:50.500122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8eaa5-8ce2-401a-8b95-61fb81f1c91a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:50.500594 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8eaa5-8ce2-401a-8b95-61fb81f1c91a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:50.501124 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8eaa5-8ce2-401a-8b95-61fb81f1c91a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:50.511912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5738e8c-ffc6-4416-b3ef-4555f50e3519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:50.512792 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5738e8c-ffc6-4416-b3ef-4555f50e3519 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:50.513268 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5738e8c-ffc6-4416-b3ef-4555f50e3519 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:50.513692 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5738e8c-ffc6-4416-b3ef-4555f50e3519 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:50.513993 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8eaa5-8ce2-401a-8b95-61fb81f1c91a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:50.515157 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5738e8c-ffc6-4416-b3ef-4555f50e3519 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:50.516749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5738e8c-ffc6-4416-b3ef-4555f50e3519 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:50.519016 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 67/127] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:50 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-b6b8eaa5-8ce2-401a-8b95-61fb81f1c91a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:50.519443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:50.520435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:50.521376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:14:50.522125 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 61/128] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:50.522838 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5738e8c-ffc6-4416-b3ef-4555f50e3519 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:50.523091 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8eaa5-8ce2-401a-8b95-61fb81f1c91a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:50.634487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:50.648478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5738e8c-ffc6-4416-b3ef-4555f50e3519 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:50.652523 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8eaa5-8ce2-401a-8b95-61fb81f1c91a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:50.691491 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a5e12-7171-4614-830d-1beb38db2734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:50.692322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a5e12-7171-4614-830d-1beb38db2734 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:50.692546 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c339060-33ad-4f5e-9510-93e1f1eb9bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:50.692663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a5e12-7171-4614-830d-1beb38db2734 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:50.693012 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a5e12-7171-4614-830d-1beb38db2734 None admin] PATH_INFO: `/v3/users/c790b85dd5ed4c03b864ddd177ed5e03` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:50.693723 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c339060-33ad-4f5e-9510-93e1f1eb9bb4 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:50.694256 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c339060-33ad-4f5e-9510-93e1f1eb9bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:50.694528 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a5e12-7171-4614-830d-1beb38db2734 None admin] RBAC: Authorizing `identity:get_user(user_id=c790b85dd5ed4c03b864ddd177ed5e03)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:50.694966 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c339060-33ad-4f5e-9510-93e1f1eb9bb4 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:50.695846 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c339060-33ad-4f5e-9510-93e1f1eb9bb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:50.696081 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a5e12-7171-4614-830d-1beb38db2734 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:50.698383 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c339060-33ad-4f5e-9510-93e1f1eb9bb4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:50.698752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 68/129] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:50 2022] GET /identity/v3/users/c790b85dd5ed4c03b864ddd177ed5e03 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:50.701946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a5e12-7171-4614-830d-1beb38db2734 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:50.790248 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 62/130] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 11 18:14:50 2022] POST /identity/v3/projects => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:14:50.791812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c339060-33ad-4f5e-9510-93e1f1eb9bb4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:50.825513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:50.883306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a5e12-7171-4614-830d-1beb38db2734 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:50.964172 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12d88b-10c6-41e9-9ae0-61bb6ec1330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:50.965184 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d88b-10c6-41e9-9ae0-61bb6ec1330b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:50.965727 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d88b-10c6-41e9-9ae0-61bb6ec1330b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:50.966295 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d88b-10c6-41e9-9ae0-61bb6ec1330b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:50.967294 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12d88b-10c6-41e9-9ae0-61bb6ec1330b None admin] RBAC: Adding query filter params (role.id=81d6b0f950354b7081637733a86bb6aa, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2, user.id=03b353fdc14c46b6a00baec1574f2ebf) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:50.967774 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12d88b-10c6-41e9-9ae0-61bb6ec1330b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:50.976362 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12d88b-10c6-41e9-9ae0-61bb6ec1330b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:50.987539 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 69/131] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:14:50 2022] GET /identity/v3/role_assignments?user.id=03b353fdc14c46b6a00baec1574f2ebf&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=81d6b0f950354b7081637733a86bb6aa => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:50.988968 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12d88b-10c6-41e9-9ae0-61bb6ec1330b None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:51.005621 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c339060-33ad-4f5e-9510-93e1f1eb9bb4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:51.062719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:51.081851 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b88f15-cc01-46b6-8979-91bfb2577593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:51.082808 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88f15-cc01-46b6-8979-91bfb2577593 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:51.083914 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88f15-cc01-46b6-8979-91bfb2577593 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:51.084366 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88f15-cc01-46b6-8979-91bfb2577593 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:51.085526 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b88f15-cc01-46b6-8979-91bfb2577593 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:51.086769 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b88f15-cc01-46b6-8979-91bfb2577593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:51.090568 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b88f15-cc01-46b6-8979-91bfb2577593 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:51.104558 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 63/132] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:14:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:51.112221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b88f15-cc01-46b6-8979-91bfb2577593 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:51.202173 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:51.243585 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b88f15-cc01-46b6-8979-91bfb2577593 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:51.261734 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12d88b-10c6-41e9-9ae0-61bb6ec1330b None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:51.290971 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8b6bb-3dda-4dac-a47f-a9e3e2c7ff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:51.292249 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8b6bb-3dda-4dac-a47f-a9e3e2c7ff1f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:51.292813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8b6bb-3dda-4dac-a47f-a9e3e2c7ff1f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:51.293248 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8b6bb-3dda-4dac-a47f-a9e3e2c7ff1f None admin] PATH_INFO: `/v3/users/c790b85dd5ed4c03b864ddd177ed5e03` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:51.294633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8b6bb-3dda-4dac-a47f-a9e3e2c7ff1f None admin] RBAC: Authorizing `identity:get_user(user_id=c790b85dd5ed4c03b864ddd177ed5e03)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:51.297342 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8b6bb-3dda-4dac-a47f-a9e3e2c7ff1f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:51.299870 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 64/133] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:51 2022] GET /identity/v3/users/c790b85dd5ed4c03b864ddd177ed5e03 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:14:51.307109 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8b6bb-3dda-4dac-a47f-a9e3e2c7ff1f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:51.314015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dbebe-c50e-4d67-a3f2-a3440eefc928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:51.314835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dbebe-c50e-4d67-a3f2-a3440eefc928 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:51.315193 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dbebe-c50e-4d67-a3f2-a3440eefc928 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:51.315537 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dbebe-c50e-4d67-a3f2-a3440eefc928 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:51.317846 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dbebe-c50e-4d67-a3f2-a3440eefc928 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:51.319584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dbebe-c50e-4d67-a3f2-a3440eefc928 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:51.321524 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 70/134] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:50 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:51.328622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dbebe-c50e-4d67-a3f2-a3440eefc928 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:51.423174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:51.435549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dbebe-c50e-4d67-a3f2-a3440eefc928 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:51.457856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8b6bb-3dda-4dac-a47f-a9e3e2c7ff1f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:51.472946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cadd0-126c-4cc0-a291-a8d46ef2ec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:51.473613 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cadd0-126c-4cc0-a291-a8d46ef2ec9f None admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:51.473894 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cadd0-126c-4cc0-a291-a8d46ef2ec9f None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:51.474190 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cadd0-126c-4cc0-a291-a8d46ef2ec9f None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/users/c790b85dd5ed4c03b864ddd177ed5e03/roles/75e4b5f3154e45059ce3a6449ac4ba3e` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:51.478994 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cadd0-126c-4cc0-a291-a8d46ef2ec9f None admin] RBAC: Authorizing `identity:create_grant(project_id=acffc2592e8c40299db4c5bf775f0ca2, user_id=c790b85dd5ed4c03b864ddd177ed5e03, role_id=75e4b5f3154e45059ce3a6449ac4ba3e)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:51.480469 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cadd0-126c-4cc0-a291-a8d46ef2ec9f None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:51.508067 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a209a-4a29-428b-89c9-30f1b16cfe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:51.508634 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a209a-4a29-428b-89c9-30f1b16cfe3a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:51.508915 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a209a-4a29-428b-89c9-30f1b16cfe3a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:51.509192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a209a-4a29-428b-89c9-30f1b16cfe3a None admin] PATH_INFO: `/v3/projects/c975759c5815431497a0cdb9170454c3` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:51.510780 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a209a-4a29-428b-89c9-30f1b16cfe3a None admin] RBAC: Authorizing `identity:get_project(project_id=c975759c5815431497a0cdb9170454c3)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:51.512320 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a209a-4a29-428b-89c9-30f1b16cfe3a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:51.513962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 65/135] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:51 2022] GET /identity/v3/projects/c975759c5815431497a0cdb9170454c3 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:51.519602 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a209a-4a29-428b-89c9-30f1b16cfe3a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:51.529996 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:51.563764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 71/136] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:14:51 2022] PUT /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/users/c790b85dd5ed4c03b864ddd177ed5e03/roles/75e4b5f3154e45059ce3a6449ac4ba3e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:14:51.648782 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a209a-4a29-428b-89c9-30f1b16cfe3a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:51.699387 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120c6c-9736-4443-854e-1dddfeea031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:51.700067 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120c6c-9736-4443-854e-1dddfeea031a None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:51.700350 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120c6c-9736-4443-854e-1dddfeea031a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:51.700631 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120c6c-9736-4443-854e-1dddfeea031a None admin] PATH_INFO: `/v3/projects/c975759c5815431497a0cdb9170454c3/users/c790b85dd5ed4c03b864ddd177ed5e03/roles/1e94f00bf0f044b89bc9bd8dab18e2fa` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:51.705792 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77120c6c-9736-4443-854e-1dddfeea031a None admin] RBAC: Authorizing `identity:create_grant(project_id=c975759c5815431497a0cdb9170454c3, user_id=c790b85dd5ed4c03b864ddd177ed5e03, role_id=1e94f00bf0f044b89bc9bd8dab18e2fa)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:51.707385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77120c6c-9736-4443-854e-1dddfeea031a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:51.803766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 66/137] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:14:51 2022] PUT /identity/v3/projects/c975759c5815431497a0cdb9170454c3/users/c790b85dd5ed4c03b864ddd177ed5e03/roles/1e94f00bf0f044b89bc9bd8dab18e2fa => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 18:14:52.262010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2cc66-b9e8-40af-b2e1-90cb7528edce None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:52.262644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2cc66-b9e8-40af-b2e1-90cb7528edce None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:52.263150 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2cc66-b9e8-40af-b2e1-90cb7528edce None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:52.264744 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 72/138] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:52.270080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ff99d-de50-4029-8594-0ca92baa6095 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:52.270621 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ff99d-de50-4029-8594-0ca92baa6095 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:52.271137 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ff99d-de50-4029-8594-0ca92baa6095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:52.295671 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-4f7ff99d-de50-4029-8594-0ca92baa6095 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:52.297189 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-4f7ff99d-de50-4029-8594-0ca92baa6095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:52.373330 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:52.381360 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 67/139] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:52.977146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2cc66-b9e8-40af-b2e1-90cb7528edce None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:53.085337 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2cc66-b9e8-40af-b2e1-90cb7528edce None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:53.117155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc9917-7d6a-46dd-a593-30dd000b8e5f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:53.118117 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc9917-7d6a-46dd-a593-30dd000b8e5f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:53.118604 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc9917-7d6a-46dd-a593-30dd000b8e5f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:53.121060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 68/140] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:53.125104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94367b-a1fe-476a-aece-1128ba5c7536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:53.125104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94367b-a1fe-476a-aece-1128ba5c7536 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:53.125104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94367b-a1fe-476a-aece-1128ba5c7536 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:53.125104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94367b-a1fe-476a-aece-1128ba5c7536 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:53.126868 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c555f-41c5-406b-9395-af1bcdc6cbb9 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:53.127373 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c555f-41c5-406b-9395-af1bcdc6cbb9 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:53.127842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c555f-41c5-406b-9395-af1bcdc6cbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:53.135569 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94367b-a1fe-476a-aece-1128ba5c7536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-3d94367b-a1fe-476a-aece-1128ba5c7536 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:53.141113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:53.147981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 73/141] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:14:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:53.148764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94367b-a1fe-476a-aece-1128ba5c7536 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:53.159470 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:53.170702 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-9c6c555f-41c5-406b-9395-af1bcdc6cbb9 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:53.172087 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-9c6c555f-41c5-406b-9395-af1bcdc6cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:53.252784 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94367b-a1fe-476a-aece-1128ba5c7536 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:53.287011 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e815a-b8c9-4efb-b949-7bba332a444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:53.287626 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e815a-b8c9-4efb-b949-7bba332a444e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:53.287910 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e815a-b8c9-4efb-b949-7bba332a444e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:53.288192 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e815a-b8c9-4efb-b949-7bba332a444e None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:53.288869 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e815a-b8c9-4efb-b949-7bba332a444e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:53.289264 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e815a-b8c9-4efb-b949-7bba332a444e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:53.290646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e815a-b8c9-4efb-b949-7bba332a444e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:53.299895 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 74/142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:14:53.305749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e815a-b8c9-4efb-b949-7bba332a444e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:53.328778 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 69/143] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:53.398091 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:53.424229 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e815a-b8c9-4efb-b949-7bba332a444e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:53.459455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1fae4-8502-4e9b-ad0c-7d48001e3791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:53.460087 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1fae4-8502-4e9b-ad0c-7d48001e3791 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:53.460373 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1fae4-8502-4e9b-ad0c-7d48001e3791 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:53.460652 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1fae4-8502-4e9b-ad0c-7d48001e3791 None admin] PATH_INFO: `/v3/users/88fec54a2c514363b52e38552e10c343` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:53.461849 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1fae4-8502-4e9b-ad0c-7d48001e3791 None admin] RBAC: Authorizing `identity:get_user(user_id=88fec54a2c514363b52e38552e10c343)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:53.464128 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1fae4-8502-4e9b-ad0c-7d48001e3791 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:53.465726 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 75/144] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:53 2022] GET /identity/v3/users/88fec54a2c514363b52e38552e10c343 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:53.471305 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c555f-41c5-406b-9395-af1bcdc6cbb9 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:53.591855 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c555f-41c5-406b-9395-af1bcdc6cbb9 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:53.628430 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:53.638207 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda9450-2f2b-4a5f-af65-3d0c2995ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:53.638857 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda9450-2f2b-4a5f-af65-3d0c2995ae4d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:53.639143 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda9450-2f2b-4a5f-af65-3d0c2995ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:53.639425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda9450-2f2b-4a5f-af65-3d0c2995ae4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:53.728679 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda9450-2f2b-4a5f-af65-3d0c2995ae4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:53.730324 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda9450-2f2b-4a5f-af65-3d0c2995ae4d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:53.899484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 70/145] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:14:53.905582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1fae4-8502-4e9b-ad0c-7d48001e3791 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:54.001716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1ab80-89a2-4024-934b-1ae6c706397a None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:54.002065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1ab80-89a2-4024-934b-1ae6c706397a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:54.002294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1ab80-89a2-4024-934b-1ae6c706397a None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:54.003881 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 71/146] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:54.008715 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525282-4562-4080-8b54-22e176859614 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:54.009002 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525282-4562-4080-8b54-22e176859614 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:54.009286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525282-4562-4080-8b54-22e176859614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:54.028916 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-62525282-4562-4080-8b54-22e176859614 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:54.030288 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-62525282-4562-4080-8b54-22e176859614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:54.059297 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:54.081458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1fae4-8502-4e9b-ad0c-7d48001e3791 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:54.110281 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 72/147] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:14:54.122862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525282-4562-4080-8b54-22e176859614 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:54.183480 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16da4a-a19e-45e5-97a4-10986bb8eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:54.184221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16da4a-a19e-45e5-97a4-10986bb8eae0 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:54.184513 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16da4a-a19e-45e5-97a4-10986bb8eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:54.184836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16da4a-a19e-45e5-97a4-10986bb8eae0 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:54.186077 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16da4a-a19e-45e5-97a4-10986bb8eae0 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:54.187586 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16da4a-a19e-45e5-97a4-10986bb8eae0 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:54.189579 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 76/148] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:53 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:54.195426 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16da4a-a19e-45e5-97a4-10986bb8eae0 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:54.206456 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:54.307038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525282-4562-4080-8b54-22e176859614 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:54.336432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16da4a-a19e-45e5-97a4-10986bb8eae0 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:54.360781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8a84a-29c4-4687-ac27-87474a5d175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:54.361693 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a84a-29c4-4687-ac27-87474a5d175a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:54.361976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a84a-29c4-4687-ac27-87474a5d175a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:54.363229 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a84a-29c4-4687-ac27-87474a5d175a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:54.375282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8a84a-29c4-4687-ac27-87474a5d175a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:54.376138 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c15238-155c-4003-964a-0b49c837f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:54.379693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c15238-155c-4003-964a-0b49c837f960 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:54.379693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c15238-155c-4003-964a-0b49c837f960 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:54.379693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c15238-155c-4003-964a-0b49c837f960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:54.379693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c15238-155c-4003-964a-0b49c837f960 None admin] RBAC: Adding query filter params (role.id=f89efd1f713043d8835c127de30f53ca, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2, user.id=88fec54a2c514363b52e38552e10c343) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:54.379693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c15238-155c-4003-964a-0b49c837f960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:54.380163 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c15238-155c-4003-964a-0b49c837f960 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-f5d8a84a-29c4-4687-ac27-87474a5d175a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:54.380547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:54.381538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:54.382500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:14:54.386752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 73/149] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:54.386752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a409a-216d-4e73-a919-cbe02571c55c None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:54.386752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a409a-216d-4e73-a919-cbe02571c55c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:54.386752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a409a-216d-4e73-a919-cbe02571c55c None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:54.388533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 74/150] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:54.389567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 77/151] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:14:54 2022] GET /identity/v3/role_assignments?user.id=88fec54a2c514363b52e38552e10c343&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=f89efd1f713043d8835c127de30f53ca => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:54.395143 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c15238-155c-4003-964a-0b49c837f960 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:54.399852 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eff23-3797-45cd-85cc-7c712613ae6e None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:54.400154 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eff23-3797-45cd-85cc-7c712613ae6e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:54.400653 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eff23-3797-45cd-85cc-7c712613ae6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:54.448594 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-910eff23-3797-45cd-85cc-7c712613ae6e None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:54.449822 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-910eff23-3797-45cd-85cc-7c712613ae6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:54.480644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:54.524588 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:54.598731 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c15238-155c-4003-964a-0b49c837f960 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:54.605716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 75/152] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:54.662178 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816091-4815-4d90-8a1b-c69ab96385b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:54.662884 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816091-4815-4d90-8a1b-c69ab96385b2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:54.663172 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816091-4815-4d90-8a1b-c69ab96385b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:54.663451 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816091-4815-4d90-8a1b-c69ab96385b2 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:54.664181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8816091-4815-4d90-8a1b-c69ab96385b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:54.664491 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8816091-4815-4d90-8a1b-c69ab96385b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:54.665930 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8816091-4815-4d90-8a1b-c69ab96385b2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:54.675529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 78/153] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:14:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:54.681534 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eff23-3797-45cd-85cc-7c712613ae6e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:54.699671 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816091-4815-4d90-8a1b-c69ab96385b2 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:54.840794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eff23-3797-45cd-85cc-7c712613ae6e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:54.843356 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816091-4815-4d90-8a1b-c69ab96385b2 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:54.905687 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:54.909419 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd565832-94b2-43b5-9c98-c1807351cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:54.910174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd565832-94b2-43b5-9c98-c1807351cf3d None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:54.910449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd565832-94b2-43b5-9c98-c1807351cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:54.910787 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd565832-94b2-43b5-9c98-c1807351cf3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:54.919461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc326f-1540-452b-a76b-809ec4041326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:54.920497 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc326f-1540-452b-a76b-809ec4041326 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:54.921175 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc326f-1540-452b-a76b-809ec4041326 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:54.921726 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc326f-1540-452b-a76b-809ec4041326 None admin] PATH_INFO: `/v3/users/c790b85dd5ed4c03b864ddd177ed5e03` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:54.924789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc326f-1540-452b-a76b-809ec4041326 None admin] RBAC: Authorizing `identity:get_user(user_id=c790b85dd5ed4c03b864ddd177ed5e03)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:54.926522 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc326f-1540-452b-a76b-809ec4041326 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:54.929142 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd565832-94b2-43b5-9c98-c1807351cf3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:54.930547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 76/154] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:54 2022] GET /identity/v3/users/c790b85dd5ed4c03b864ddd177ed5e03 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-bd565832-94b2-43b5-9c98-c1807351cf3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:54.935127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:54.936104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:54.937253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 79/155] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:14:54.942462 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc326f-1540-452b-a76b-809ec4041326 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:54.944174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd565832-94b2-43b5-9c98-c1807351cf3d None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:54.969944 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:55.105338 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd565832-94b2-43b5-9c98-c1807351cf3d None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:55.129875 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc326f-1540-452b-a76b-809ec4041326 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:55.176604 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4015c5-8283-4fae-bb87-f05aa51e18c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:55.177476 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4015c5-8283-4fae-bb87-f05aa51e18c2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.180204 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4015c5-8283-4fae-bb87-f05aa51e18c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.180681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4015c5-8283-4fae-bb87-f05aa51e18c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.183988 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4015c5-8283-4fae-bb87-f05aa51e18c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:55.184555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4015c5-8283-4fae-bb87-f05aa51e18c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:55.187363 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4015c5-8283-4fae-bb87-f05aa51e18c2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:55.204944 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 80/156] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:14:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:55.212257 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4015c5-8283-4fae-bb87-f05aa51e18c2 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:55.215936 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20219517-6480-4560-be32-1c5add9fc46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:55.216568 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219517-6480-4560-be32-1c5add9fc46b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.216850 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219517-6480-4560-be32-1c5add9fc46b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.217127 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219517-6480-4560-be32-1c5add9fc46b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.294321 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20219517-6480-4560-be32-1c5add9fc46b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:55.295841 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20219517-6480-4560-be32-1c5add9fc46b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:55.311962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:55.315030 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:55.326782 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4015c5-8283-4fae-bb87-f05aa51e18c2 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:55.364771 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81656cce-de05-4224-88d6-18b56eea88fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:55.365486 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81656cce-de05-4224-88d6-18b56eea88fb None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.365841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81656cce-de05-4224-88d6-18b56eea88fb None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.366184 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81656cce-de05-4224-88d6-18b56eea88fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.367431 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81656cce-de05-4224-88d6-18b56eea88fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:55.369004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81656cce-de05-4224-88d6-18b56eea88fb None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:55.371715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 81/157] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:55.376949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81656cce-de05-4224-88d6-18b56eea88fb None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:55.404085 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 77/158] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:14:55.405325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2fd4-90bf-4697-baa0-fada3e911175 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.405620 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2fd4-90bf-4697-baa0-fada3e911175 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.405897 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2fd4-90bf-4697-baa0-fada3e911175 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.407193 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 78/159] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:55.411098 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa2fd4-90bf-4697-baa0-fada3e911175 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:55.481058 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81656cce-de05-4224-88d6-18b56eea88fb None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:55.503277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:55.510198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa2fd4-90bf-4697-baa0-fada3e911175 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:55.514335 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d64d-7c69-4f41-b95c-ea880a988101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:55.514997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d64d-7c69-4f41-b95c-ea880a988101 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.515282 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d64d-7c69-4f41-b95c-ea880a988101 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.515554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d64d-7c69-4f41-b95c-ea880a988101 None admin] PATH_INFO: `/v3/users/03b353fdc14c46b6a00baec1574f2ebf` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.516680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510d64d-7c69-4f41-b95c-ea880a988101 None admin] RBAC: Authorizing `identity:get_user(user_id=03b353fdc14c46b6a00baec1574f2ebf)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:55.518196 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510d64d-7c69-4f41-b95c-ea880a988101 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:55.519892 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 82/160] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:55 2022] GET /identity/v3/users/03b353fdc14c46b6a00baec1574f2ebf => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:55.521154 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51815b9-649c-4ce3-b6c5-da8486837b04 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.521438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51815b9-649c-4ce3-b6c5-da8486837b04 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.521716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51815b9-649c-4ce3-b6c5-da8486837b04 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.523223 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 83/161] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:55.523974 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51815b9-649c-4ce3-b6c5-da8486837b04 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:55.527612 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:55.548460 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376673f4-59d5-419a-a0a1-c848d562cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:55.549071 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376673f4-59d5-419a-a0a1-c848d562cd40 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.549354 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376673f4-59d5-419a-a0a1-c848d562cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.549632 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376673f4-59d5-419a-a0a1-c848d562cd40 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.550276 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376673f4-59d5-419a-a0a1-c848d562cd40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:55.551771 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376673f4-59d5-419a-a0a1-c848d562cd40 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:55.627043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 79/162] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:14:55 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:14:55.631767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51815b9-649c-4ce3-b6c5-da8486837b04 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:55.632194 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3025a-d42b-4475-9632-fb6651f5d068 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.632486 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3025a-d42b-4475-9632-fb6651f5d068 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.632765 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3025a-d42b-4475-9632-fb6651f5d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.655957 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-7cb3025a-d42b-4475-9632-fb6651f5d068 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:55.657206 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-7cb3025a-d42b-4475-9632-fb6651f5d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:55.674412 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9db20b-c95a-4308-916a-21a080c70650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:55.675105 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db20b-c95a-4308-916a-21a080c70650 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.677422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db20b-c95a-4308-916a-21a080c70650 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.677422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db20b-c95a-4308-916a-21a080c70650 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.677422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9db20b-c95a-4308-916a-21a080c70650 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:55.678343 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9db20b-c95a-4308-916a-21a080c70650 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:55.680090 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 84/163] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:55 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:55.680911 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9db20b-c95a-4308-916a-21a080c70650 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:55.750330 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:55.753059 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 80/164] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:55.758338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1e22d-b6a2-4e44-b0fe-2c4aa0553c3b None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.758338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1e22d-b6a2-4e44-b0fe-2c4aa0553c3b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.758338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1e22d-b6a2-4e44-b0fe-2c4aa0553c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.780129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-78c1e22d-b6a2-4e44-b0fe-2c4aa0553c3b None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:55.781914 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-78c1e22d-b6a2-4e44-b0fe-2c4aa0553c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:55.808332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9db20b-c95a-4308-916a-21a080c70650 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:55.850488 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6836c-f927-434f-a979-f811919215a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:55.851710 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6836c-f927-434f-a979-f811919215a7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:55.852006 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6836c-f927-434f-a979-f811919215a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:55.852280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6836c-f927-434f-a979-f811919215a7 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:55.854264 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6836c-f927-434f-a979-f811919215a7 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:55.856437 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6836c-f927-434f-a979-f811919215a7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:55.858804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 85/165] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:55 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:55.863085 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6836c-f927-434f-a979-f811919215a7 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:55.873856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 81/166] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:55.875060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1e22d-b6a2-4e44-b0fe-2c4aa0553c3b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:55.908936 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:55.981466 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6836c-f927-434f-a979-f811919215a7 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:55.986417 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1e22d-b6a2-4e44-b0fe-2c4aa0553c3b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:56.011080 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:56.021347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ec0c2-1d54-42fb-960e-de413188c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:56.023922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ec0c2-1d54-42fb-960e-de413188c1cf None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:56.023922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ec0c2-1d54-42fb-960e-de413188c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:56.023922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ec0c2-1d54-42fb-960e-de413188c1cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:56.024147 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96642f5-93c5-4f7f-8706-008a861d0311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:56.024516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ec0c2-1d54-42fb-960e-de413188c1cf None admin] RBAC: Adding query filter params (role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2, user.id=c790b85dd5ed4c03b864ddd177ed5e03) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:56.024807 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96642f5-93c5-4f7f-8706-008a861d0311 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:56.025093 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96642f5-93c5-4f7f-8706-008a861d0311 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:56.025943 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ec0c2-1d54-42fb-960e-de413188c1cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:56.026041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96642f5-93c5-4f7f-8706-008a861d0311 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/users/03b353fdc14c46b6a00baec1574f2ebf/roles/81d6b0f950354b7081637733a86bb6aa` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:56.027884 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ec0c2-1d54-42fb-960e-de413188c1cf None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:56.027989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96642f5-93c5-4f7f-8706-008a861d0311 None admin] RBAC: Authorizing `identity:create_grant(project_id=acffc2592e8c40299db4c5bf775f0ca2, user_id=03b353fdc14c46b6a00baec1574f2ebf, role_id=81d6b0f950354b7081637733a86bb6aa)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:56.029444 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96642f5-93c5-4f7f-8706-008a861d0311 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:56.034771 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 86/167] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:14:55 2022] GET /identity/v3/role_assignments?user.id=c790b85dd5ed4c03b864ddd177ed5e03&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:56.115870 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ec0c2-1d54-42fb-960e-de413188c1cf None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:56.131243 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 82/168] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:14:55 2022] PUT /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/users/03b353fdc14c46b6a00baec1574f2ebf/roles/81d6b0f950354b7081637733a86bb6aa => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:14:56.253127 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96642f5-93c5-4f7f-8706-008a861d0311 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:56.254222 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ec0c2-1d54-42fb-960e-de413188c1cf None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:56.294786 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651c813-75d1-4246-89ee-40e46fd451f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:56.295766 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651c813-75d1-4246-89ee-40e46fd451f5 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:56.296301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651c813-75d1-4246-89ee-40e46fd451f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:56.296880 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651c813-75d1-4246-89ee-40e46fd451f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:56.310258 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651c813-75d1-4246-89ee-40e46fd451f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-3651c813-75d1-4246-89ee-40e46fd451f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:56.316529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:56.317567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:14:56.318344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:56.321100 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 87/169] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:14:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:56.332446 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651c813-75d1-4246-89ee-40e46fd451f5 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:56.408612 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:56.419118 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:56.422869 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96642f5-93c5-4f7f-8706-008a861d0311 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:56.467982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73008b94-17eb-472f-8766-0c2f072f810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:56.468976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73008b94-17eb-472f-8766-0c2f072f810c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:56.469539 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73008b94-17eb-472f-8766-0c2f072f810c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:56.469828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73008b94-17eb-472f-8766-0c2f072f810c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:56.479324 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651c813-75d1-4246-89ee-40e46fd451f5 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:56.484591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73008b94-17eb-472f-8766-0c2f072f810c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-73008b94-17eb-472f-8766-0c2f072f810c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:56.490906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:56.491775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:14:56.492565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 83/170] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:56.498790 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73008b94-17eb-472f-8766-0c2f072f810c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:56.531104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a4e1-81bf-4295-b960-42c1098948d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:56.531756 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a4e1-81bf-4295-b960-42c1098948d4 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:56.532042 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a4e1-81bf-4295-b960-42c1098948d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:56.532336 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a4e1-81bf-4295-b960-42c1098948d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:56.533549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07a4e1-81bf-4295-b960-42c1098948d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:56.533887 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07a4e1-81bf-4295-b960-42c1098948d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:56.535632 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07a4e1-81bf-4295-b960-42c1098948d4 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:56.547285 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 88/171] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:14:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:56.556181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a4e1-81bf-4295-b960-42c1098948d4 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:56.646497 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73008b94-17eb-472f-8766-0c2f072f810c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:56.692093 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eea126-ca1f-41df-9d61-3011f714dde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:56.692766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eea126-ca1f-41df-9d61-3011f714dde2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:56.693047 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eea126-ca1f-41df-9d61-3011f714dde2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:56.693322 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eea126-ca1f-41df-9d61-3011f714dde2 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:56.694002 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eea126-ca1f-41df-9d61-3011f714dde2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:56.694299 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eea126-ca1f-41df-9d61-3011f714dde2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:56.695700 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a4e1-81bf-4295-b960-42c1098948d4 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:56.695812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eea126-ca1f-41df-9d61-3011f714dde2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:56.706657 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 84/172] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:14:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:14:56.716930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eea126-ca1f-41df-9d61-3011f714dde2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:56.717821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:56.736123 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:56.748298 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49add86e-8085-4c21-a5aa-e490608b2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:56.749659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49add86e-8085-4c21-a5aa-e490608b2697 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:56.749659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49add86e-8085-4c21-a5aa-e490608b2697 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:56.749951 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49add86e-8085-4c21-a5aa-e490608b2697 None admin] PATH_INFO: `/v3/users/c790b85dd5ed4c03b864ddd177ed5e03` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:56.752391 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49add86e-8085-4c21-a5aa-e490608b2697 None admin] RBAC: Authorizing `identity:get_user(user_id=c790b85dd5ed4c03b864ddd177ed5e03)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:56.753979 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49add86e-8085-4c21-a5aa-e490608b2697 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:56.755932 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 89/173] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:56 2022] GET /identity/v3/users/c790b85dd5ed4c03b864ddd177ed5e03 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:56.762611 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49add86e-8085-4c21-a5aa-e490608b2697 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:56.854801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eea126-ca1f-41df-9d61-3011f714dde2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:56.897838 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976da21-b611-4b36-949d-c4b022a6b00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:56.898644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976da21-b611-4b36-949d-c4b022a6b00f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:56.899054 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976da21-b611-4b36-949d-c4b022a6b00f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:56.899421 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976da21-b611-4b36-949d-c4b022a6b00f None admin] PATH_INFO: `/v3/users/c790b85dd5ed4c03b864ddd177ed5e03` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:56.901730 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976da21-b611-4b36-949d-c4b022a6b00f None admin] RBAC: Authorizing `identity:get_user(user_id=c790b85dd5ed4c03b864ddd177ed5e03)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:56.903616 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976da21-b611-4b36-949d-c4b022a6b00f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:56.905804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 85/174] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:56 2022] GET /identity/v3/users/c790b85dd5ed4c03b864ddd177ed5e03 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:56.911907 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976da21-b611-4b36-949d-c4b022a6b00f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:56.956853 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49add86e-8085-4c21-a5aa-e490608b2697 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:57.009201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:57.032655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976da21-b611-4b36-949d-c4b022a6b00f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:57.046692 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7b17-57d7-4ce6-8056-df953c2525cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:57.047318 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7b17-57d7-4ce6-8056-df953c2525cb None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:57.047604 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7b17-57d7-4ce6-8056-df953c2525cb None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:57.047878 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7b17-57d7-4ce6-8056-df953c2525cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:57.073378 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da609b17-f520-4985-8376-14b8347a660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:57.074320 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da609b17-f520-4985-8376-14b8347a660c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:57.074833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da609b17-f520-4985-8376-14b8347a660c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:57.075298 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da609b17-f520-4985-8376-14b8347a660c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:57.159320 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da609b17-f520-4985-8376-14b8347a660c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:57.162195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da609b17-f520-4985-8376-14b8347a660c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:57.169372 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:57.231771 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7b17-57d7-4ce6-8056-df953c2525cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:57.233258 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7b17-57d7-4ce6-8056-df953c2525cb None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:57.257754 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:57.279576 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 86/175] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:14:57.285409 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da609b17-f520-4985-8376-14b8347a660c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:57.410718 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 90/176] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 18:14:57.416577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7b17-57d7-4ce6-8056-df953c2525cb None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:57.432535 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da609b17-f520-4985-8376-14b8347a660c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:57.503867 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6e92f-76a7-415e-8d6b-9cf0caaf26e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:57.504628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e92f-76a7-415e-8d6b-9cf0caaf26e3 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:57.505031 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e92f-76a7-415e-8d6b-9cf0caaf26e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:57.505320 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e92f-76a7-415e-8d6b-9cf0caaf26e3 None admin] PATH_INFO: `/v3/projects/c975759c5815431497a0cdb9170454c3` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:57.506494 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6e92f-76a7-415e-8d6b-9cf0caaf26e3 None admin] RBAC: Authorizing `identity:get_project(project_id=c975759c5815431497a0cdb9170454c3)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:57.508105 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6e92f-76a7-415e-8d6b-9cf0caaf26e3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:57.516241 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 87/177] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:57 2022] GET /identity/v3/projects/c975759c5815431497a0cdb9170454c3 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:14:57.517359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6e92f-76a7-415e-8d6b-9cf0caaf26e3 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:57.566050 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:57.602224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:57.604147 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7b17-57d7-4ce6-8056-df953c2525cb None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:57.649041 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e179d0f-f204-4d76-bb7a-f3ad337ded46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:57.649672 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e179d0f-f204-4d76-bb7a-f3ad337ded46 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:57.649954 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e179d0f-f204-4d76-bb7a-f3ad337ded46 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:57.650229 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e179d0f-f204-4d76-bb7a-f3ad337ded46 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:57.651804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e179d0f-f204-4d76-bb7a-f3ad337ded46 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:57.653260 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e179d0f-f204-4d76-bb7a-f3ad337ded46 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:57.655402 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 91/178] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:14:57 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:57.661956 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e179d0f-f204-4d76-bb7a-f3ad337ded46 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:57.705192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6e92f-76a7-415e-8d6b-9cf0caaf26e3 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:57.779756 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473f1ce-627d-4310-8c5d-f5fbff0ded17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:57.780366 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473f1ce-627d-4310-8c5d-f5fbff0ded17 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:57.780654 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473f1ce-627d-4310-8c5d-f5fbff0ded17 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:57.780929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473f1ce-627d-4310-8c5d-f5fbff0ded17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:57.781660 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473f1ce-627d-4310-8c5d-f5fbff0ded17 None admin] RBAC: Adding query filter params (role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, scope.project.id=c975759c5815431497a0cdb9170454c3, user.id=c790b85dd5ed4c03b864ddd177ed5e03) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:57.781972 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473f1ce-627d-4310-8c5d-f5fbff0ded17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:57.783456 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473f1ce-627d-4310-8c5d-f5fbff0ded17 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:57.796878 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 88/179] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:14:57 2022] GET /identity/v3/role_assignments?user.id=c790b85dd5ed4c03b864ddd177ed5e03&scope.project.id=c975759c5815431497a0cdb9170454c3&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:14:57.831149 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e179d0f-f204-4d76-bb7a-f3ad337ded46 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:57.871950 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea77c0-24af-4743-94f7-c8ba869c2bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:57.872629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea77c0-24af-4743-94f7-c8ba869c2bfb None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:57.872912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea77c0-24af-4743-94f7-c8ba869c2bfb None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:57.873185 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea77c0-24af-4743-94f7-c8ba869c2bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:57.873971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea77c0-24af-4743-94f7-c8ba869c2bfb None admin] RBAC: Adding query filter params (role.id=75e4b5f3154e45059ce3a6449ac4ba3e, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2, user.id=c790b85dd5ed4c03b864ddd177ed5e03) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:57.874364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea77c0-24af-4743-94f7-c8ba869c2bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:57.876323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea77c0-24af-4743-94f7-c8ba869c2bfb None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:57.886491 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 92/180] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:14:57 2022] GET /identity/v3/role_assignments?user.id=c790b85dd5ed4c03b864ddd177ed5e03&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=75e4b5f3154e45059ce3a6449ac4ba3e => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:58.789214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efb94-cbe7-46e1-9d39-21849d388d2f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:58.789714 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efb94-cbe7-46e1-9d39-21849d388d2f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:58.789822 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efb94-cbe7-46e1-9d39-21849d388d2f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:58.791801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 89/181] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:58.797742 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa97f2-5b49-47ed-8e8a-3113d28d953a None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:58.798161 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa97f2-5b49-47ed-8e8a-3113d28d953a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:58.798333 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa97f2-5b49-47ed-8e8a-3113d28d953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:58.817666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-8baa97f2-5b49-47ed-8e8a-3113d28d953a None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:58.818876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-8baa97f2-5b49-47ed-8e8a-3113d28d953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:58.827486 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:58.895838 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 93/182] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:59.244984 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efb94-cbe7-46e1-9d39-21849d388d2f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:59.292640 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0dd65-ea67-42be-915f-51311ea911e0 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.292961 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0dd65-ea67-42be-915f-51311ea911e0 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.293192 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0dd65-ea67-42be-915f-51311ea911e0 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:59.294539 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 94/183] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:14:59.299516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34de1e-e2ae-42c1-9563-96ab7f693c82 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.299795 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34de1e-e2ae-42c1-9563-96ab7f693c82 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.300068 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34de1e-e2ae-42c1-9563-96ab7f693c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:59.322999 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-5b34de1e-e2ae-42c1-9563-96ab7f693c82 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:59.324581 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-5b34de1e-e2ae-42c1-9563-96ab7f693c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:59.359195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efb94-cbe7-46e1-9d39-21849d388d2f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:59.377159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:59.399506 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a8f71-c815-4826-923a-b3dfc90da17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:59.399711 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 95/184] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:59.401892 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc8b3f-8a88-4bda-8ecb-e8bc6465b375 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.402279 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc8b3f-8a88-4bda-8ecb-e8bc6465b375 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.402554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc8b3f-8a88-4bda-8ecb-e8bc6465b375 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:59.403947 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 96/185] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:59.407380 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a8f71-c815-4826-923a-b3dfc90da17f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.407975 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a8f71-c815-4826-923a-b3dfc90da17f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.408352 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a8f71-c815-4826-923a-b3dfc90da17f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:59.409450 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18caa8-6203-419b-960c-8538adaa87bb None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.409919 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18caa8-6203-419b-960c-8538adaa87bb None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.410370 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18caa8-6203-419b-960c-8538adaa87bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:59.422839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a8f71-c815-4826-923a-b3dfc90da17f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-2a8a8f71-c815-4826-923a-b3dfc90da17f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:59.428475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:59.429375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:14:59.437037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 90/186] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:14:59.437793 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-9b18caa8-6203-419b-960c-8538adaa87bb None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:59.437793 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-9b18caa8-6203-419b-960c-8538adaa87bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:59.440032 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a8f71-c815-4826-923a-b3dfc90da17f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:59.526181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 97/187] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:59.526181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eb33d-cd31-4b04-94a9-e1bc395dd980 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.526181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eb33d-cd31-4b04-94a9-e1bc395dd980 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.526181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eb33d-cd31-4b04-94a9-e1bc395dd980 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:59.526181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 98/188] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:14:59.530551 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d20cd-a95c-44ab-a0ac-986f301327dc None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.530838 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d20cd-a95c-44ab-a0ac-986f301327dc None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.531111 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d20cd-a95c-44ab-a0ac-986f301327dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:59.537308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:59.549481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-d54d20cd-a95c-44ab-a0ac-986f301327dc None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:14:59.550716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-d54d20cd-a95c-44ab-a0ac-986f301327dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:14:59.553172 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a8f71-c815-4826-923a-b3dfc90da17f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:59.589026 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c079a4b-0838-4153-8804-3a09763c893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:59.589658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c079a4b-0838-4153-8804-3a09763c893b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.589938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c079a4b-0838-4153-8804-3a09763c893b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.590212 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c079a4b-0838-4153-8804-3a09763c893b None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:59.590917 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c079a4b-0838-4153-8804-3a09763c893b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:14:59.591221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c079a4b-0838-4153-8804-3a09763c893b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:59.592605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c079a4b-0838-4153-8804-3a09763c893b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:59.601268 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 91/189] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:59.607722 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c079a4b-0838-4153-8804-3a09763c893b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:59.626055 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 99/190] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:14:59.649376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:59.727570 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c079a4b-0838-4153-8804-3a09763c893b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:59.733098 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d20cd-a95c-44ab-a0ac-986f301327dc None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:59.779024 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81df5b-4b9f-4965-83b2-81231810f38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:59.779724 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81df5b-4b9f-4965-83b2-81231810f38b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.780096 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81df5b-4b9f-4965-83b2-81231810f38b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.780447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81df5b-4b9f-4965-83b2-81231810f38b None admin] PATH_INFO: `/v3/users/c1afbf4cd34846de9429d7245b3c886c` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:59.799185 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81df5b-4b9f-4965-83b2-81231810f38b None admin] RBAC: Authorizing `identity:get_user(user_id=c1afbf4cd34846de9429d7245b3c886c)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:14:59.800938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81df5b-4b9f-4965-83b2-81231810f38b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:14:59.806743 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 92/191] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:14:59 2022] GET /identity/v3/users/c1afbf4cd34846de9429d7245b3c886c => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:14:59.809408 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81df5b-4b9f-4965-83b2-81231810f38b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:59.866490 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d20cd-a95c-44ab-a0ac-986f301327dc None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:59.900992 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:59.906128 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc56f6-0534-4fc1-a436-18903605b2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:59.906794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc56f6-0534-4fc1-a436-18903605b2c3 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.907079 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc56f6-0534-4fc1-a436-18903605b2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.907357 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc56f6-0534-4fc1-a436-18903605b2c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:14:59.918372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:14:59.918520 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc56f6-0534-4fc1-a436-18903605b2c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-b1dc56f6-0534-4fc1-a436-18903605b2c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:14:59.923829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:14:59.924991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:14:59.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:14:59.927702 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 100/192] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:14:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:14:59.928426 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc56f6-0534-4fc1-a436-18903605b2c3 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:14:59.934157 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81df5b-4b9f-4965-83b2-81231810f38b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:14:59.972709 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b491cb-9835-435d-90ac-17dbc3c91c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:14:59.973315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b491cb-9835-435d-90ac-17dbc3c91c13 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:14:59.973593 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b491cb-9835-435d-90ac-17dbc3c91c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:14:59.974171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b491cb-9835-435d-90ac-17dbc3c91c13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:00.030123 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc56f6-0534-4fc1-a436-18903605b2c3 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:00.040302 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b491cb-9835-435d-90ac-17dbc3c91c13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:00.042012 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b491cb-9835-435d-90ac-17dbc3c91c13 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:00.063792 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3346448-bf0c-4897-a6a1-4e9084d37a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:00.064425 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3346448-bf0c-4897-a6a1-4e9084d37a35 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:00.064707 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3346448-bf0c-4897-a6a1-4e9084d37a35 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:00.064976 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3346448-bf0c-4897-a6a1-4e9084d37a35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:00.066094 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3346448-bf0c-4897-a6a1-4e9084d37a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:00.067591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3346448-bf0c-4897-a6a1-4e9084d37a35 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:00.069152 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 101/193] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:14:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:00.069919 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3346448-bf0c-4897-a6a1-4e9084d37a35 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:00.129959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:00.132773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:00.141559 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 93/194] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 18:15:00.141559 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b491cb-9835-435d-90ac-17dbc3c91c13 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:00.169911 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3346448-bf0c-4897-a6a1-4e9084d37a35 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:00.203119 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a460-6492-4b9a-aa30-5bac983bb8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:00.203711 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a460-6492-4b9a-aa30-5bac983bb8b6 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:00.203985 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a460-6492-4b9a-aa30-5bac983bb8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:00.204253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a460-6492-4b9a-aa30-5bac983bb8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:00.204910 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01a460-6492-4b9a-aa30-5bac983bb8b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:00.205208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01a460-6492-4b9a-aa30-5bac983bb8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:00.206556 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01a460-6492-4b9a-aa30-5bac983bb8b6 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:00.214734 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 102/195] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:00.219934 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a460-6492-4b9a-aa30-5bac983bb8b6 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:00.244588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b491cb-9835-435d-90ac-17dbc3c91c13 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:00.278654 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdd0d0-ab76-4ffc-b798-6a669393a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:00.280050 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdd0d0-ab76-4ffc-b798-6a669393a400 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:00.280378 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdd0d0-ab76-4ffc-b798-6a669393a400 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:00.280604 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdd0d0-ab76-4ffc-b798-6a669393a400 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:00.291731 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdd0d0-ab76-4ffc-b798-6a669393a400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-0bbdd0d0-ab76-4ffc-b798-6a669393a400 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:00.296785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:00.297842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 94/196] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:15:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:00.298628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdd0d0-ab76-4ffc-b798-6a669393a400 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:00.321733 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a460-6492-4b9a-aa30-5bac983bb8b6 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:00.343709 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:00.350790 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:00.355428 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5e43d-d425-49f8-83b3-eb083ad5a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:00.356025 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5e43d-d425-49f8-83b3-eb083ad5a318 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:00.356305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5e43d-d425-49f8-83b3-eb083ad5a318 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:00.356578 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5e43d-d425-49f8-83b3-eb083ad5a318 None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:00.357717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5e43d-d425-49f8-83b3-eb083ad5a318 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:00.358825 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5e43d-d425-49f8-83b3-eb083ad5a318 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:00.397026 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdd0d0-ab76-4ffc-b798-6a669393a400 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:00.430231 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ce07a-b513-4656-8bde-8f961aed4079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:00.430881 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ce07a-b513-4656-8bde-8f961aed4079 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:00.431159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ce07a-b513-4656-8bde-8f961aed4079 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:00.431433 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ce07a-b513-4656-8bde-8f961aed4079 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:00.432385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 103/197] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:15:00 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:15:00.433070 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ce07a-b513-4656-8bde-8f961aed4079 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:00.433221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5e43d-d425-49f8-83b3-eb083ad5a318 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:00.434653 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ce07a-b513-4656-8bde-8f961aed4079 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:00.441932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 95/198] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:00 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:00.441932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ce07a-b513-4656-8bde-8f961aed4079 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:00.550793 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ce07a-b513-4656-8bde-8f961aed4079 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:00.555262 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5e43d-d425-49f8-83b3-eb083ad5a318 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:00.579805 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:00.595800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff585e69-2b08-4a0f-90e8-222f9b03a3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:00.596416 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff585e69-2b08-4a0f-90e8-222f9b03a3ec None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:00.596700 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff585e69-2b08-4a0f-90e8-222f9b03a3ec None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:00.596972 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff585e69-2b08-4a0f-90e8-222f9b03a3ec None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:00.597075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa0a3-9777-491a-a54e-6240d4764b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:00.597645 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff585e69-2b08-4a0f-90e8-222f9b03a3ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:00.597764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa0a3-9777-491a-a54e-6240d4764b74 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:00.597949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff585e69-2b08-4a0f-90e8-222f9b03a3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:00.598047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa0a3-9777-491a-a54e-6240d4764b74 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:00.598256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa0a3-9777-491a-a54e-6240d4764b74 None admin] PATH_INFO: `/v3/users/03b353fdc14c46b6a00baec1574f2ebf` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:00.599373 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff585e69-2b08-4a0f-90e8-222f9b03a3ec None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:00.599493 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fa0a3-9777-491a-a54e-6240d4764b74 None admin] RBAC: Authorizing `identity:get_user(user_id=03b353fdc14c46b6a00baec1574f2ebf)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:00.600865 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fa0a3-9777-491a-a54e-6240d4764b74 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:00.608506 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 104/199] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:00 2022] GET /identity/v3/users/03b353fdc14c46b6a00baec1574f2ebf => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:00.608506 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa0a3-9777-491a-a54e-6240d4764b74 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:00.609404 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 96/200] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:00.610331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff585e69-2b08-4a0f-90e8-222f9b03a3ec None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:00.663916 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:00.727085 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa0a3-9777-491a-a54e-6240d4764b74 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:00.735031 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff585e69-2b08-4a0f-90e8-222f9b03a3ec None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:00.797449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c79091-884d-4e24-a2fd-969e8e0f8374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:00.798062 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79091-884d-4e24-a2fd-969e8e0f8374 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:00.798346 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79091-884d-4e24-a2fd-969e8e0f8374 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:00.798619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79091-884d-4e24-a2fd-969e8e0f8374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:00.799384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c79091-884d-4e24-a2fd-969e8e0f8374 None admin] RBAC: Adding query filter params (role.id=f89efd1f713043d8835c127de30f53ca, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165, user.id=c1afbf4cd34846de9429d7245b3c886c) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:00.799694 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c79091-884d-4e24-a2fd-969e8e0f8374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:00.801611 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c79091-884d-4e24-a2fd-969e8e0f8374 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:00.806306 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba70a7-0876-4ff7-a360-29cdd4bc6c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:00.806995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba70a7-0876-4ff7-a360-29cdd4bc6c9d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:00.807242 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba70a7-0876-4ff7-a360-29cdd4bc6c9d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:00.807702 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba70a7-0876-4ff7-a360-29cdd4bc6c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:00.814773 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 105/201] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:00 2022] GET /identity/v3/role_assignments?user.id=c1afbf4cd34846de9429d7245b3c886c&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=f89efd1f713043d8835c127de30f53ca => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:00.815892 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c79091-884d-4e24-a2fd-969e8e0f8374 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:00.872431 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:00.896955 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba70a7-0876-4ff7-a360-29cdd4bc6c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:00.898783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba70a7-0876-4ff7-a360-29cdd4bc6c9d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:01.033759 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 97/202] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:01.039448 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba70a7-0876-4ff7-a360-29cdd4bc6c9d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:01.167098 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c79091-884d-4e24-a2fd-969e8e0f8374 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:01.180037 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:01.207426 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f446e-923d-4584-9205-1298765d2a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:01.208332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f446e-923d-4584-9205-1298765d2a48 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:01.208782 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f446e-923d-4584-9205-1298765d2a48 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:01.209225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f446e-923d-4584-9205-1298765d2a48 None admin] PATH_INFO: `/v3/users/c1afbf4cd34846de9429d7245b3c886c` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:01.210703 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f446e-923d-4584-9205-1298765d2a48 None admin] RBAC: Authorizing `identity:get_user(user_id=c1afbf4cd34846de9429d7245b3c886c)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:01.212727 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f446e-923d-4584-9205-1298765d2a48 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:01.215723 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 106/203] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:00 2022] GET /identity/v3/users/c1afbf4cd34846de9429d7245b3c886c => generated 283 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:01.222233 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f446e-923d-4584-9205-1298765d2a48 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:01.271034 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:01.333200 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba70a7-0876-4ff7-a360-29cdd4bc6c9d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:01.368035 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f446e-923d-4584-9205-1298765d2a48 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:01.439474 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdcd86-f0c2-4cb7-b2e0-714cf9e3da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:01.440454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcd86-f0c2-4cb7-b2e0-714cf9e3da15 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:01.440931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcd86-f0c2-4cb7-b2e0-714cf9e3da15 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:01.441398 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcd86-f0c2-4cb7-b2e0-714cf9e3da15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:01.539460 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:01.563344 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4474c-d91d-44ff-9996-a6d282dc9882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:01.563979 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4474c-d91d-44ff-9996-a6d282dc9882 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:01.564254 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4474c-d91d-44ff-9996-a6d282dc9882 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:01.564522 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4474c-d91d-44ff-9996-a6d282dc9882 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:01.566975 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4474c-d91d-44ff-9996-a6d282dc9882 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:01.569019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4474c-d91d-44ff-9996-a6d282dc9882 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:01.570942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 98/204] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:01 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:01.579762 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4474c-d91d-44ff-9996-a6d282dc9882 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:01.586784 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdcd86-f0c2-4cb7-b2e0-714cf9e3da15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:01.588319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdcd86-f0c2-4cb7-b2e0-714cf9e3da15 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:01.754068 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 107/205] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:01.757513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4474c-d91d-44ff-9996-a6d282dc9882 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:01.759498 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdcd86-f0c2-4cb7-b2e0-714cf9e3da15 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:01.843403 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb418522-cea0-4e45-bd5b-ea45e120e5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:01.844086 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb418522-cea0-4e45-bd5b-ea45e120e5ad None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:01.844365 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb418522-cea0-4e45-bd5b-ea45e120e5ad None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:01.844643 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb418522-cea0-4e45-bd5b-ea45e120e5ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:01.845371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb418522-cea0-4e45-bd5b-ea45e120e5ad None admin] RBAC: Adding query filter params (role.id=81d6b0f950354b7081637733a86bb6aa, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2, user.id=03b353fdc14c46b6a00baec1574f2ebf) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:01.845476 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:01.845680 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb418522-cea0-4e45-bd5b-ea45e120e5ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:01.847173 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb418522-cea0-4e45-bd5b-ea45e120e5ad None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:01.861693 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 99/206] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:01 2022] GET /identity/v3/role_assignments?user.id=03b353fdc14c46b6a00baec1574f2ebf&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=81d6b0f950354b7081637733a86bb6aa => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:01.873572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdcd86-f0c2-4cb7-b2e0-714cf9e3da15 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:01.971455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c988e98-a41c-4269-b632-4e6041551c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:01.972491 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988e98-a41c-4269-b632-4e6041551c20 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:01.973020 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988e98-a41c-4269-b632-4e6041551c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:01.973489 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988e98-a41c-4269-b632-4e6041551c20 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:01.980075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c988e98-a41c-4269-b632-4e6041551c20 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:01.981905 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c988e98-a41c-4269-b632-4e6041551c20 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:01.984128 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 108/207] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:01 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:01.990201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb418522-cea0-4e45-bd5b-ea45e120e5ad None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:02.024107 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:02.143770 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb418522-cea0-4e45-bd5b-ea45e120e5ad None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:02.179840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c94a43-c040-4a7e-ad9f-c9b25ed6c502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:02.180453 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c94a43-c040-4a7e-ad9f-c9b25ed6c502 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:02.180735 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c94a43-c040-4a7e-ad9f-c9b25ed6c502 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:02.181062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c94a43-c040-4a7e-ad9f-c9b25ed6c502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:02.182338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c94a43-c040-4a7e-ad9f-c9b25ed6c502 None admin] RBAC: Adding query filter params (role.id=75e4b5f3154e45059ce3a6449ac4ba3e, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165, user.id=c1afbf4cd34846de9429d7245b3c886c) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:02.182654 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c94a43-c040-4a7e-ad9f-c9b25ed6c502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:02.184236 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c94a43-c040-4a7e-ad9f-c9b25ed6c502 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:02.190840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 100/208] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:01 2022] GET /identity/v3/role_assignments?user.id=c1afbf4cd34846de9429d7245b3c886c&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=75e4b5f3154e45059ce3a6449ac4ba3e => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:03.102139 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688295da-d91a-4ef6-b30a-df6fbaebfc9e None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:03.103137 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688295da-d91a-4ef6-b30a-df6fbaebfc9e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:03.103674 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688295da-d91a-4ef6-b30a-df6fbaebfc9e None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:03.105686 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 109/209] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:03.110629 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b0ac1-d6b4-4710-bd12-31e72b4ace91 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:03.111053 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b0ac1-d6b4-4710-bd12-31e72b4ace91 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:03.111295 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b0ac1-d6b4-4710-bd12-31e72b4ace91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:03.130234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-119b0ac1-d6b4-4710-bd12-31e72b4ace91 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:03.131476 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-119b0ac1-d6b4-4710-bd12-31e72b4ace91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:03.187443 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53d4e-a33c-439b-9a43-5b98ebbadc4a None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:03.187803 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53d4e-a33c-439b-9a43-5b98ebbadc4a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:03.188095 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53d4e-a33c-439b-9a43-5b98ebbadc4a None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:03.189778 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 110/210] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:15:03.194589 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb219e-7cdb-4e85-aebe-d3d4d65a47a7 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:03.194908 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb219e-7cdb-4e85-aebe-d3d4d65a47a7 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:03.195186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb219e-7cdb-4e85-aebe-d3d4d65a47a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:03.208963 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 101/211] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:03.216149 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-34cb219e-7cdb-4e85-aebe-d3d4d65a47a7 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:03.217402 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-34cb219e-7cdb-4e85-aebe-d3d4d65a47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:03.292327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 111/212] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:03.422568 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b607f-5ad5-4f98-87c5-75c3afaa7acf None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:03.422995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b607f-5ad5-4f98-87c5-75c3afaa7acf None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:03.423399 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b607f-5ad5-4f98-87c5-75c3afaa7acf None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:03.425075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 102/213] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:03.430232 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5f13-01e7-47a4-a7b6-0ea848e54480 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:03.430636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5f13-01e7-47a4-a7b6-0ea848e54480 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:03.431031 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd5f13-01e7-47a4-a7b6-0ea848e54480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:03.450521 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-4fcd5f13-01e7-47a4-a7b6-0ea848e54480 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:03.451727 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-4fcd5f13-01e7-47a4-a7b6-0ea848e54480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:03.520806 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 112/214] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:03.538395 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b607f-5ad5-4f98-87c5-75c3afaa7acf None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:03.550347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:03.646480 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd5f13-01e7-47a4-a7b6-0ea848e54480 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:03.649458 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b607f-5ad5-4f98-87c5-75c3afaa7acf None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:03.655648 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:03.688733 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df55d9-2655-4fb3-82ec-d1331016ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:03.689287 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df55d9-2655-4fb3-82ec-d1331016ec11 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:03.689564 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df55d9-2655-4fb3-82ec-d1331016ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:03.689839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df55d9-2655-4fb3-82ec-d1331016ec11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:03.702269 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df55d9-2655-4fb3-82ec-d1331016ec11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-97df55d9-2655-4fb3-82ec-d1331016ec11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:03.708389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:03.709457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:03.710427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 103/215] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:03.716705 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df55d9-2655-4fb3-82ec-d1331016ec11 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:03.784391 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd5f13-01e7-47a4-a7b6-0ea848e54480 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:03.807329 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:03.826087 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991d139-1214-46c0-a144-14dfe22fff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:03.827088 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991d139-1214-46c0-a144-14dfe22fff5a None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:03.827642 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991d139-1214-46c0-a144-14dfe22fff5a None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:03.828121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991d139-1214-46c0-a144-14dfe22fff5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:03.829484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991d139-1214-46c0-a144-14dfe22fff5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:03.831186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991d139-1214-46c0-a144-14dfe22fff5a None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:03.836981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 113/216] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:03.839933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991d139-1214-46c0-a144-14dfe22fff5a None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:03.848184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df55d9-2655-4fb3-82ec-d1331016ec11 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:03.886433 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de797b-89cc-4553-9500-da7b246805d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:03.887087 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de797b-89cc-4553-9500-da7b246805d0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:03.887367 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de797b-89cc-4553-9500-da7b246805d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:03.887645 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de797b-89cc-4553-9500-da7b246805d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:03.888307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de797b-89cc-4553-9500-da7b246805d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:03.888613 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de797b-89cc-4553-9500-da7b246805d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:03.889999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de797b-89cc-4553-9500-da7b246805d0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:03.902838 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 104/217] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:03.903728 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de797b-89cc-4553-9500-da7b246805d0 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:03.929987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:03.957830 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991d139-1214-46c0-a144-14dfe22fff5a None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:03.996576 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54884b8-50a6-48de-b10b-8d04127be52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:03.997184 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54884b8-50a6-48de-b10b-8d04127be52f None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:03.997464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54884b8-50a6-48de-b10b-8d04127be52f None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:03.997737 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54884b8-50a6-48de-b10b-8d04127be52f None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:03.998384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54884b8-50a6-48de-b10b-8d04127be52f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:04.000111 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54884b8-50a6-48de-b10b-8d04127be52f None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:04.011197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de797b-89cc-4553-9500-da7b246805d0 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:04.040279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:04.047704 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c89325-46cf-48fc-981b-404ea231bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:04.048336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c89325-46cf-48fc-981b-404ea231bd72 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:04.048618 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c89325-46cf-48fc-981b-404ea231bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:04.048893 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c89325-46cf-48fc-981b-404ea231bd72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:04.059878 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c89325-46cf-48fc-981b-404ea231bd72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-68c89325-46cf-48fc-981b-404ea231bd72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:04.064644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:04.065567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:04.066411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 105/218] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:04.067193 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c89325-46cf-48fc-981b-404ea231bd72 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:04.114694 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 114/219] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:15:03 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:15:04.114694 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54884b8-50a6-48de-b10b-8d04127be52f None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:04.191659 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c89325-46cf-48fc-981b-404ea231bd72 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:04.243284 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91334c8f-651b-4169-ab00-ef411d18be13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:04.243933 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91334c8f-651b-4169-ab00-ef411d18be13 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:04.244770 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91334c8f-651b-4169-ab00-ef411d18be13 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:04.245046 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91334c8f-651b-4169-ab00-ef411d18be13 None admin] PATH_INFO: `/v3/users/a137587b3a10483fb2ef1310709e1277` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:04.263856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91334c8f-651b-4169-ab00-ef411d18be13 None admin] RBAC: Authorizing `identity:get_user(user_id=a137587b3a10483fb2ef1310709e1277)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:04.265377 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91334c8f-651b-4169-ab00-ef411d18be13 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:04.268521 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 106/220] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:04 2022] GET /identity/v3/users/a137587b3a10483fb2ef1310709e1277 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:04.271623 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54884b8-50a6-48de-b10b-8d04127be52f None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:04.274044 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91334c8f-651b-4169-ab00-ef411d18be13 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:04.303946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:04.312814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539436e-0914-4f9d-8696-a2b4615b3946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:04.314492 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539436e-0914-4f9d-8696-a2b4615b3946 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:04.314492 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539436e-0914-4f9d-8696-a2b4615b3946 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:04.314492 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539436e-0914-4f9d-8696-a2b4615b3946 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:04.314922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539436e-0914-4f9d-8696-a2b4615b3946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:04.315371 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539436e-0914-4f9d-8696-a2b4615b3946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:04.316840 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539436e-0914-4f9d-8696-a2b4615b3946 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:04.328585 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 115/221] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:04.334717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539436e-0914-4f9d-8696-a2b4615b3946 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:04.349725 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:04.435592 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91334c8f-651b-4169-ab00-ef411d18be13 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:04.488091 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979a25f-2610-4911-8484-c36afc9e38c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:04.488729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979a25f-2610-4911-8484-c36afc9e38c6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:04.489009 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979a25f-2610-4911-8484-c36afc9e38c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:04.489298 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979a25f-2610-4911-8484-c36afc9e38c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:04.490981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539436e-0914-4f9d-8696-a2b4615b3946 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:04.532331 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba04cf-dd4b-4026-a81c-784e8eb8d107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:04.533418 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba04cf-dd4b-4026-a81c-784e8eb8d107 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:04.533877 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba04cf-dd4b-4026-a81c-784e8eb8d107 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:04.534325 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba04cf-dd4b-4026-a81c-784e8eb8d107 None admin] PATH_INFO: `/v3/users/c1afbf4cd34846de9429d7245b3c886c` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:04.535687 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba04cf-dd4b-4026-a81c-784e8eb8d107 None admin] RBAC: Authorizing `identity:get_user(user_id=c1afbf4cd34846de9429d7245b3c886c)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:04.537377 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba04cf-dd4b-4026-a81c-784e8eb8d107 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:04.539465 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 116/222] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:04 2022] GET /identity/v3/users/c1afbf4cd34846de9429d7245b3c886c => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:04.540855 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732b3d2-c8aa-4c23-a022-71edb30d0650 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:04.541822 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732b3d2-c8aa-4c23-a022-71edb30d0650 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:04.542292 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732b3d2-c8aa-4c23-a022-71edb30d0650 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:04.544779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 117/223] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:04.545780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732b3d2-c8aa-4c23-a022-71edb30d0650 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:04.587512 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979a25f-2610-4911-8484-c36afc9e38c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:04.590219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979a25f-2610-4911-8484-c36afc9e38c6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:04.616266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:04.656294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:04.661324 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732b3d2-c8aa-4c23-a022-71edb30d0650 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:04.699067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f3abc-aae6-40a3-bb63-514019c14a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:04.700588 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f3abc-aae6-40a3-bb63-514019c14a31 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:04.700937 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f3abc-aae6-40a3-bb63-514019c14a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:04.701367 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f3abc-aae6-40a3-bb63-514019c14a31 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:04.702715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f3abc-aae6-40a3-bb63-514019c14a31 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:04.704720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f3abc-aae6-40a3-bb63-514019c14a31 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:04.706933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 118/224] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:04 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:04.708359 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df4d5b-78b6-48a7-bd4f-361aedad5112 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:04.708706 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df4d5b-78b6-48a7-bd4f-361aedad5112 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:04.709050 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df4d5b-78b6-48a7-bd4f-361aedad5112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:04.723066 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 107/225] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 18:15:04.724416 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979a25f-2610-4911-8484-c36afc9e38c6 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:04.730271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-d5df4d5b-78b6-48a7-bd4f-361aedad5112 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:04.731734 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-d5df4d5b-78b6-48a7-bd4f-361aedad5112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:04.819076 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 119/226] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:04.819076 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df4d5b-78b6-48a7-bd4f-361aedad5112 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:04.891172 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979a25f-2610-4911-8484-c36afc9e38c6 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:04.911635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:04.960034 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df4d5b-78b6-48a7-bd4f-361aedad5112 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:04.975455 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b300d-8957-4898-a385-2d18bfc0dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:04.976438 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b300d-8957-4898-a385-2d18bfc0dfcb None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:04.977934 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b300d-8957-4898-a385-2d18bfc0dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:04.978406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b300d-8957-4898-a385-2d18bfc0dfcb None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/users/c1afbf4cd34846de9429d7245b3c886c/roles/f89efd1f713043d8835c127de30f53ca` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:04.982318 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b300d-8957-4898-a385-2d18bfc0dfcb None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5c02b35e89464a8e8356e42fbf5165, user_id=c1afbf4cd34846de9429d7245b3c886c, role_id=f89efd1f713043d8835c127de30f53ca)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:04.985252 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b300d-8957-4898-a385-2d18bfc0dfcb None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:05.012209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc348b-89e3-4792-b6a3-cc0ab5724249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:05.013189 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc348b-89e3-4792-b6a3-cc0ab5724249 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:05.013724 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc348b-89e3-4792-b6a3-cc0ab5724249 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:05.014185 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc348b-89e3-4792-b6a3-cc0ab5724249 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:05.015675 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc348b-89e3-4792-b6a3-cc0ab5724249 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:05.017359 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc348b-89e3-4792-b6a3-cc0ab5724249 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:05.019267 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 120/227] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:04 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:05.025341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc348b-89e3-4792-b6a3-cc0ab5724249 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:05.067713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 108/228] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:15:04 2022] PUT /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/users/c1afbf4cd34846de9429d7245b3c886c/roles/f89efd1f713043d8835c127de30f53ca => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:05.145798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc348b-89e3-4792-b6a3-cc0ab5724249 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:05.185987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:05.201638 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958cfa0-f3dc-40dc-9200-e601a0927dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:05.206808 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958cfa0-f3dc-40dc-9200-e601a0927dd6 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:05.206808 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958cfa0-f3dc-40dc-9200-e601a0927dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:05.206808 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958cfa0-f3dc-40dc-9200-e601a0927dd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:05.206808 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958cfa0-f3dc-40dc-9200-e601a0927dd6 None admin] RBAC: Adding query filter params (role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165, user.id=a137587b3a10483fb2ef1310709e1277) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:05.206808 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958cfa0-f3dc-40dc-9200-e601a0927dd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:05.206808 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958cfa0-f3dc-40dc-9200-e601a0927dd6 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:05.213745 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 121/229] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:05 2022] GET /identity/v3/role_assignments?user.id=a137587b3a10483fb2ef1310709e1277&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:05.230433 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b300d-8957-4898-a385-2d18bfc0dfcb None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:05.249536 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:05.365056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b300d-8957-4898-a385-2d18bfc0dfcb None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:05.406480 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965b4a0-7f1c-431e-9297-71d860cb2d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:05.407087 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965b4a0-7f1c-431e-9297-71d860cb2d0c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:05.407365 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965b4a0-7f1c-431e-9297-71d860cb2d0c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:05.407638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965b4a0-7f1c-431e-9297-71d860cb2d0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:05.420000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965b4a0-7f1c-431e-9297-71d860cb2d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-6965b4a0-7f1c-431e-9297-71d860cb2d0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:05.424995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:05.425951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:05.427221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 109/230] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:15:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:05.432457 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958cfa0-f3dc-40dc-9200-e601a0927dd6 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:05.544886 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958cfa0-f3dc-40dc-9200-e601a0927dd6 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:05.581512 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d214f-0e5d-4e74-80ee-be76f6293ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:05.582117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d214f-0e5d-4e74-80ee-be76f6293ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:05.582397 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d214f-0e5d-4e74-80ee-be76f6293ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:05.582680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d214f-0e5d-4e74-80ee-be76f6293ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:05.583363 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d214f-0e5d-4e74-80ee-be76f6293ce6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:05.583662 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d214f-0e5d-4e74-80ee-be76f6293ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:05.585029 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d214f-0e5d-4e74-80ee-be76f6293ce6 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:05.597645 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 122/231] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:05.603370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965b4a0-7f1c-431e-9297-71d860cb2d0c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:05.698652 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:05.741816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965b4a0-7f1c-431e-9297-71d860cb2d0c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:05.779112 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b89fc-33b3-4f24-b2b0-fbc9a6038968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:05.779774 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b89fc-33b3-4f24-b2b0-fbc9a6038968 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:05.780023 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b89fc-33b3-4f24-b2b0-fbc9a6038968 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:05.780299 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b89fc-33b3-4f24-b2b0-fbc9a6038968 None admin] PATH_INFO: `/v3/users/c1afbf4cd34846de9429d7245b3c886c` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:05.781449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b89fc-33b3-4f24-b2b0-fbc9a6038968 None admin] RBAC: Authorizing `identity:get_user(user_id=c1afbf4cd34846de9429d7245b3c886c)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:05.782992 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b89fc-33b3-4f24-b2b0-fbc9a6038968 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:05.784774 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 110/232] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:05 2022] GET /identity/v3/users/c1afbf4cd34846de9429d7245b3c886c => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:05.790362 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d214f-0e5d-4e74-80ee-be76f6293ce6 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:05.861488 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:05.915024 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d214f-0e5d-4e74-80ee-be76f6293ce6 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:05.949970 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d43ac7-bab0-4638-8639-95d2090979e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:05.950524 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d43ac7-bab0-4638-8639-95d2090979e2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:05.955099 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d43ac7-bab0-4638-8639-95d2090979e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:05.955384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d43ac7-bab0-4638-8639-95d2090979e2 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:05.956581 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d43ac7-bab0-4638-8639-95d2090979e2 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:05.958038 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d43ac7-bab0-4638-8639-95d2090979e2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:05.959985 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 123/233] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:05 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:05.967446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b89fc-33b3-4f24-b2b0-fbc9a6038968 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:06.079897 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b89fc-33b3-4f24-b2b0-fbc9a6038968 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:06.114163 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c73e-ecaf-4d1d-99dd-2e1993eb2cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:06.114853 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c73e-ecaf-4d1d-99dd-2e1993eb2cb5 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:06.115129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c73e-ecaf-4d1d-99dd-2e1993eb2cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:06.115396 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c73e-ecaf-4d1d-99dd-2e1993eb2cb5 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/users/c1afbf4cd34846de9429d7245b3c886c/roles/75e4b5f3154e45059ce3a6449ac4ba3e` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:06.117630 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c73e-ecaf-4d1d-99dd-2e1993eb2cb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5c02b35e89464a8e8356e42fbf5165, user_id=c1afbf4cd34846de9429d7245b3c886c, role_id=75e4b5f3154e45059ce3a6449ac4ba3e)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:06.119099 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c73e-ecaf-4d1d-99dd-2e1993eb2cb5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:06.122297 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:06.266403 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 111/234] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:15:05 2022] PUT /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/users/c1afbf4cd34846de9429d7245b3c886c/roles/75e4b5f3154e45059ce3a6449ac4ba3e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:06.824294 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c85900-fa49-4aff-a6b6-44861c2e8712 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:06.824803 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c85900-fa49-4aff-a6b6-44861c2e8712 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:06.824803 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c85900-fa49-4aff-a6b6-44861c2e8712 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:06.826431 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 124/235] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:06.831536 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059d15b-89f4-4835-98a2-318da2f5a0fa None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:06.831825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059d15b-89f4-4835-98a2-318da2f5a0fa None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:06.832102 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059d15b-89f4-4835-98a2-318da2f5a0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:06.855660 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b059d15b-89f4-4835-98a2-318da2f5a0fa None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:06.856871 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b059d15b-89f4-4835-98a2-318da2f5a0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:06.944842 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 112/236] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:07.318928 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac1838-54f7-4bee-b0a7-79d259f3747c None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:07.319305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac1838-54f7-4bee-b0a7-79d259f3747c None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:07.319505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac1838-54f7-4bee-b0a7-79d259f3747c None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:07.320829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 125/237] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:07.327023 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ab13d-7572-42cd-8bce-72f46f208ad1 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:07.327465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ab13d-7572-42cd-8bce-72f46f208ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:07.327632 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ab13d-7572-42cd-8bce-72f46f208ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:07.351656 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-2f1ab13d-7572-42cd-8bce-72f46f208ad1 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:07.352856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-2f1ab13d-7572-42cd-8bce-72f46f208ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:07.444176 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 113/238] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:07.468940 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac1838-54f7-4bee-b0a7-79d259f3747c None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:07.596529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac1838-54f7-4bee-b0a7-79d259f3747c None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:07.621241 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:07.644805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b282-4a1f-4d8b-9186-b50bbc0e81c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:07.645455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b282-4a1f-4d8b-9186-b50bbc0e81c0 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:07.645737 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b282-4a1f-4d8b-9186-b50bbc0e81c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:07.646009 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b282-4a1f-4d8b-9186-b50bbc0e81c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:07.659220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13b282-4a1f-4d8b-9186-b50bbc0e81c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-9c13b282-4a1f-4d8b-9186-b50bbc0e81c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:07.663989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:07.664868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:07.665720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 126/239] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:07.671621 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ab13d-7572-42cd-8bce-72f46f208ad1 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:07.757174 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:07.850524 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ab13d-7572-42cd-8bce-72f46f208ad1 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:07.917947 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b92b-5423-45cb-9ca0-deaaaa03db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:07.918571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b92b-5423-45cb-9ca0-deaaaa03db05 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:07.918878 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b92b-5423-45cb-9ca0-deaaaa03db05 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:07.919154 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136b92b-5423-45cb-9ca0-deaaaa03db05 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:07.919825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136b92b-5423-45cb-9ca0-deaaaa03db05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:07.920127 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136b92b-5423-45cb-9ca0-deaaaa03db05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:07.921511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136b92b-5423-45cb-9ca0-deaaaa03db05 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:07.930435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 114/240] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:07.937110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b282-4a1f-4d8b-9186-b50bbc0e81c0 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:07.941793 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b92b-5423-45cb-9ca0-deaaaa03db05 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:08.045952 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b282-4a1f-4d8b-9186-b50bbc0e81c0 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:08.086863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323ac3e-7519-49ea-9fc4-9e9c4d5caea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:08.087948 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ac3e-7519-49ea-9fc4-9e9c4d5caea8 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.088949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ac3e-7519-49ea-9fc4-9e9c4d5caea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.089373 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ac3e-7519-49ea-9fc4-9e9c4d5caea8 None admin] PATH_INFO: `/v3/users/ced91250a31e429d93243fa321bc7f16` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.094442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136b92b-5423-45cb-9ca0-deaaaa03db05 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:08.107369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323ac3e-7519-49ea-9fc4-9e9c4d5caea8 None admin] RBAC: Authorizing `identity:get_user(user_id=ced91250a31e429d93243fa321bc7f16)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:08.109440 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323ac3e-7519-49ea-9fc4-9e9c4d5caea8 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:08.115695 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 127/241] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:07 2022] GET /identity/v3/users/ced91250a31e429d93243fa321bc7f16 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:08.115826 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:08.115904 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105e654-8ccd-4d31-96a0-1ac2b56166d1 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.115904 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105e654-8ccd-4d31-96a0-1ac2b56166d1 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.115904 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105e654-8ccd-4d31-96a0-1ac2b56166d1 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.115904 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 128/242] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:08.120579 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e982a-7d46-460a-98cf-795d4ddf7aa2 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.120579 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e982a-7d46-460a-98cf-795d4ddf7aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.120579 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e982a-7d46-460a-98cf-795d4ddf7aa2 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.120579 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 129/243] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:08.121053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e982a-7d46-460a-98cf-795d4ddf7aa2 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:08.132549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3fb6d-af6f-4aad-9827-b01de44c375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:08.133172 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3fb6d-af6f-4aad-9827-b01de44c375c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.133452 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3fb6d-af6f-4aad-9827-b01de44c375c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.133722 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3fb6d-af6f-4aad-9827-b01de44c375c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.135070 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3fb6d-af6f-4aad-9827-b01de44c375c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:08.137216 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3fb6d-af6f-4aad-9827-b01de44c375c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:08.139116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 115/244] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:08.140334 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7be5-7c8f-404d-9080-738e2ad0d966 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.140614 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7be5-7c8f-404d-9080-738e2ad0d966 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.140885 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd7be5-7c8f-404d-9080-738e2ad0d966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.159767 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-dcdd7be5-7c8f-404d-9080-738e2ad0d966 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:08.160937 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-dcdd7be5-7c8f-404d-9080-738e2ad0d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:08.175195 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:08.231326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 116/245] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:08.232607 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa5df6-7c2d-44ab-aebf-09e288c399d3 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.232889 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa5df6-7c2d-44ab-aebf-09e288c399d3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.233163 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa5df6-7c2d-44ab-aebf-09e288c399d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.250894 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f4fa5df6-7c2d-44ab-aebf-09e288c399d3 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:08.252055 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e982a-7d46-460a-98cf-795d4ddf7aa2 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:08.252203 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f4fa5df6-7c2d-44ab-aebf-09e288c399d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:08.292775 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218144b2-0beb-4301-8edd-e879465f61be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:08.294172 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218144b2-0beb-4301-8edd-e879465f61be None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.294598 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218144b2-0beb-4301-8edd-e879465f61be None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.295035 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218144b2-0beb-4301-8edd-e879465f61be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.330986 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 117/246] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:08.339822 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa5df6-7c2d-44ab-aebf-09e288c399d3 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:08.384547 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218144b2-0beb-4301-8edd-e879465f61be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:08.387320 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218144b2-0beb-4301-8edd-e879465f61be None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:08.432763 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:08.456130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:08.507689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 130/247] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:08.515633 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218144b2-0beb-4301-8edd-e879465f61be None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:08.589523 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa5df6-7c2d-44ab-aebf-09e288c399d3 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:08.633263 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf86f-ce52-426c-9c9d-2d96a614edf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:08.633973 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf86f-ce52-426c-9c9d-2d96a614edf0 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.634257 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf86f-ce52-426c-9c9d-2d96a614edf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.634532 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf86f-ce52-426c-9c9d-2d96a614edf0 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.635807 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebf86f-ce52-426c-9c9d-2d96a614edf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:08.637226 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebf86f-ce52-426c-9c9d-2d96a614edf0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:08.640964 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218144b2-0beb-4301-8edd-e879465f61be None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:08.678749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd265e1-54b4-4452-a8ad-36765a73d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:08.679465 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd265e1-54b4-4452-a8ad-36765a73d2b6 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.679815 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd265e1-54b4-4452-a8ad-36765a73d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.680155 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd265e1-54b4-4452-a8ad-36765a73d2b6 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.681338 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd265e1-54b4-4452-a8ad-36765a73d2b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:08.683514 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd265e1-54b4-4452-a8ad-36765a73d2b6 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:08.685323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 131/248] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:08 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:08.686366 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd265e1-54b4-4452-a8ad-36765a73d2b6 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:08.695518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:08.730167 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 118/249] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:15:08 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:15:08.731317 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf86f-ce52-426c-9c9d-2d96a614edf0 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:08.829038 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd265e1-54b4-4452-a8ad-36765a73d2b6 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:08.866815 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf86f-ce52-426c-9c9d-2d96a614edf0 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:08.869113 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:08.870288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642125e-0972-48a1-9155-12feb26e9659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:08.870993 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642125e-0972-48a1-9155-12feb26e9659 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.871281 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642125e-0972-48a1-9155-12feb26e9659 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.871552 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642125e-0972-48a1-9155-12feb26e9659 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.884805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642125e-0972-48a1-9155-12feb26e9659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-0642125e-0972-48a1-9155-12feb26e9659 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:08.891341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:08.892404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 132/250] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:08.894263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642125e-0972-48a1-9155-12feb26e9659 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:08.944519 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c7371-f264-48e8-b4ba-67b6fcc06bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:08.944519 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c7371-f264-48e8-b4ba-67b6fcc06bb6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:08.944808 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c7371-f264-48e8-b4ba-67b6fcc06bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:08.944890 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c7371-f264-48e8-b4ba-67b6fcc06bb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:08.945926 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c7371-f264-48e8-b4ba-67b6fcc06bb6 None admin] RBAC: Adding query filter params (role.id=81d6b0f950354b7081637733a86bb6aa, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165, user.id=ced91250a31e429d93243fa321bc7f16) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:08.945926 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c7371-f264-48e8-b4ba-67b6fcc06bb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:08.948166 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c7371-f264-48e8-b4ba-67b6fcc06bb6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:08.956553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 119/251] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:08 2022] GET /identity/v3/role_assignments?user.id=ced91250a31e429d93243fa321bc7f16&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=81d6b0f950354b7081637733a86bb6aa => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:08.957664 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c7371-f264-48e8-b4ba-67b6fcc06bb6 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:08.985298 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:09.038308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642125e-0972-48a1-9155-12feb26e9659 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:09.094488 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdb210-73c9-4a2a-a1dc-14db07dfbf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:09.095485 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdb210-73c9-4a2a-a1dc-14db07dfbf01 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:09.095941 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdb210-73c9-4a2a-a1dc-14db07dfbf01 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:09.096306 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c7371-f264-48e8-b4ba-67b6fcc06bb6 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:09.096514 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdb210-73c9-4a2a-a1dc-14db07dfbf01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:09.114213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdb210-73c9-4a2a-a1dc-14db07dfbf01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-1ecdb210-73c9-4a2a-a1dc-14db07dfbf01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:09.122497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:09.123715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:15:09.124643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:09.127823 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 133/252] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:09.129521 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2a71d-b172-4d4c-95fa-a1d0d844f6e4 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:09.129954 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2a71d-b172-4d4c-95fa-a1d0d844f6e4 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:09.130478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2a71d-b172-4d4c-95fa-a1d0d844f6e4 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:09.132073 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 134/253] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:09.133620 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2a71d-b172-4d4c-95fa-a1d0d844f6e4 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:09.147894 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687ecf6-3f34-48d5-8bff-89289e512587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:09.148453 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ecf6-3f34-48d5-8bff-89289e512587 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:09.148745 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ecf6-3f34-48d5-8bff-89289e512587 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:09.149041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ecf6-3f34-48d5-8bff-89289e512587 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:09.150047 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687ecf6-3f34-48d5-8bff-89289e512587 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:09.150360 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687ecf6-3f34-48d5-8bff-89289e512587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:09.152216 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687ecf6-3f34-48d5-8bff-89289e512587 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:09.166846 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 120/254] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:09.167940 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15653-18fb-4750-8266-747a15c42595 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:09.168229 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15653-18fb-4750-8266-747a15c42595 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:09.168507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15653-18fb-4750-8266-747a15c42595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:09.193196 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-9af15653-18fb-4750-8266-747a15c42595 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:09.194409 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-9af15653-18fb-4750-8266-747a15c42595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:09.227800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:09.272460 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2a71d-b172-4d4c-95fa-a1d0d844f6e4 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:09.286005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 121/255] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:09.286628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15653-18fb-4750-8266-747a15c42595 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:09.312015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:09.325816 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f8d07-916d-4e9b-b619-cc6149ce7f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:09.327455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f8d07-916d-4e9b-b619-cc6149ce7f71 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:09.327455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f8d07-916d-4e9b-b619-cc6149ce7f71 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:09.327455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f8d07-916d-4e9b-b619-cc6149ce7f71 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:09.327797 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f8d07-916d-4e9b-b619-cc6149ce7f71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:09.331022 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f8d07-916d-4e9b-b619-cc6149ce7f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:09.332614 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f8d07-916d-4e9b-b619-cc6149ce7f71 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:09.354481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 135/256] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:09.360488 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f8d07-916d-4e9b-b619-cc6149ce7f71 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:09.502971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f8d07-916d-4e9b-b619-cc6149ce7f71 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:09.507376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15653-18fb-4750-8266-747a15c42595 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:09.542550 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3edca-1914-440b-a605-33a2a410ecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:09.543205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3edca-1914-440b-a605-33a2a410ecc6 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:09.543480 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3edca-1914-440b-a605-33a2a410ecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:09.543743 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3edca-1914-440b-a605-33a2a410ecc6 None admin] PATH_INFO: `/v3/users/c1afbf4cd34846de9429d7245b3c886c` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:09.545666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3edca-1914-440b-a605-33a2a410ecc6 None admin] RBAC: Authorizing `identity:get_user(user_id=c1afbf4cd34846de9429d7245b3c886c)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:09.548375 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3edca-1914-440b-a605-33a2a410ecc6 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:09.558554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 136/257] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:09 2022] GET /identity/v3/users/c1afbf4cd34846de9429d7245b3c886c => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:09.560910 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3edca-1914-440b-a605-33a2a410ecc6 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:09.595707 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011fb99-b3b8-4d2a-9090-9c6e5ff31110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:09.596353 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011fb99-b3b8-4d2a-9090-9c6e5ff31110 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:09.596682 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011fb99-b3b8-4d2a-9090-9c6e5ff31110 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:09.596956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011fb99-b3b8-4d2a-9090-9c6e5ff31110 None admin] PATH_INFO: `/v3/users/a137587b3a10483fb2ef1310709e1277` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:09.598143 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011fb99-b3b8-4d2a-9090-9c6e5ff31110 None admin] RBAC: Authorizing `identity:get_user(user_id=a137587b3a10483fb2ef1310709e1277)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:09.601203 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011fb99-b3b8-4d2a-9090-9c6e5ff31110 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:09.606646 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 122/258] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:09 2022] GET /identity/v3/users/a137587b3a10483fb2ef1310709e1277 => generated 297 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:09.609200 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011fb99-b3b8-4d2a-9090-9c6e5ff31110 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:09.663776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:09.683070 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:09.782103 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3edca-1914-440b-a605-33a2a410ecc6 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:09.788376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011fb99-b3b8-4d2a-9090-9c6e5ff31110 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:09.837756 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e7e45-d8e5-433d-a3c1-2c0ee9a8c238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:09.839044 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e7e45-d8e5-433d-a3c1-2c0ee9a8c238 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:09.839324 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e7e45-d8e5-433d-a3c1-2c0ee9a8c238 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:09.839596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e7e45-d8e5-433d-a3c1-2c0ee9a8c238 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:09.841085 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e7e45-d8e5-433d-a3c1-2c0ee9a8c238 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:09.843596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e7e45-d8e5-433d-a3c1-2c0ee9a8c238 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:09.852997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892a2d8-1ee1-4603-9459-f9b59b45b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:09.852997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a2d8-1ee1-4603-9459-f9b59b45b2a2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:09.852997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a2d8-1ee1-4603-9459-f9b59b45b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:09.852997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a2d8-1ee1-4603-9459-f9b59b45b2a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:09.853412 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 123/259] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:09 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:09.853412 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e7e45-d8e5-433d-a3c1-2c0ee9a8c238 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:10.011257 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:10.018447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e7e45-d8e5-433d-a3c1-2c0ee9a8c238 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:10.062009 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798a984-8506-4296-b48c-3ff569ae1c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:10.062613 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798a984-8506-4296-b48c-3ff569ae1c15 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:10.062924 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798a984-8506-4296-b48c-3ff569ae1c15 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:10.065574 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798a984-8506-4296-b48c-3ff569ae1c15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:10.074509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892a2d8-1ee1-4603-9459-f9b59b45b2a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:10.077045 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892a2d8-1ee1-4603-9459-f9b59b45b2a2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:10.086731 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798a984-8506-4296-b48c-3ff569ae1c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-e798a984-8506-4296-b48c-3ff569ae1c15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:10.101998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:10.102930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 124/260] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:15:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:10.104171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798a984-8506-4296-b48c-3ff569ae1c15 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:10.159059 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:10.219718 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 137/261] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:10.220591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892a2d8-1ee1-4603-9459-f9b59b45b2a2 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:10.309712 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798a984-8506-4296-b48c-3ff569ae1c15 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:10.384718 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd6726-eeba-4aa3-85fd-b264607a1354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:10.385823 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd6726-eeba-4aa3-85fd-b264607a1354 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:10.386105 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd6726-eeba-4aa3-85fd-b264607a1354 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:10.386383 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd6726-eeba-4aa3-85fd-b264607a1354 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/users/a137587b3a10483fb2ef1310709e1277/roles/1e94f00bf0f044b89bc9bd8dab18e2fa` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:10.389666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd6726-eeba-4aa3-85fd-b264607a1354 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5c02b35e89464a8e8356e42fbf5165, user_id=a137587b3a10483fb2ef1310709e1277, role_id=1e94f00bf0f044b89bc9bd8dab18e2fa)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:10.391159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd6726-eeba-4aa3-85fd-b264607a1354 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:10.407523 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892a2d8-1ee1-4603-9459-f9b59b45b2a2 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:10.444490 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2dd3-5e9f-456a-a743-aece96ff1ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:10.445444 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2dd3-5e9f-456a-a743-aece96ff1ee7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:10.445917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2dd3-5e9f-456a-a743-aece96ff1ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:10.446490 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2dd3-5e9f-456a-a743-aece96ff1ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:10.447385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f2dd3-5e9f-456a-a743-aece96ff1ee7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:10.448436 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f2dd3-5e9f-456a-a743-aece96ff1ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:10.450113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f2dd3-5e9f-456a-a743-aece96ff1ee7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:10.459601 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 138/262] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:10.460810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2dd3-5e9f-456a-a743-aece96ff1ee7 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:10.483845 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:10.485188 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 125/263] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:15:10 2022] PUT /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/users/a137587b3a10483fb2ef1310709e1277/roles/1e94f00bf0f044b89bc9bd8dab18e2fa => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:10.486059 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd6726-eeba-4aa3-85fd-b264607a1354 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:10.522775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:10.593075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2dd3-5e9f-456a-a743-aece96ff1ee7 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:10.636315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a112db3-d999-4afb-a343-c4e45401ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:10.637342 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a112db3-d999-4afb-a343-c4e45401ec28 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:10.637820 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a112db3-d999-4afb-a343-c4e45401ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:10.638298 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a112db3-d999-4afb-a343-c4e45401ec28 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:10.639818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a112db3-d999-4afb-a343-c4e45401ec28 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:10.641905 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a112db3-d999-4afb-a343-c4e45401ec28 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:10.644599 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 139/264] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:10 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:10.651422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a112db3-d999-4afb-a343-c4e45401ec28 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:10.746951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd6726-eeba-4aa3-85fd-b264607a1354 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:10.775118 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:10.792430 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a112db3-d999-4afb-a343-c4e45401ec28 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:10.831297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8625cdd-bc90-4807-ac71-06908a6e2203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:10.832275 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8625cdd-bc90-4807-ac71-06908a6e2203 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:10.832976 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8625cdd-bc90-4807-ac71-06908a6e2203 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:10.833445 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8625cdd-bc90-4807-ac71-06908a6e2203 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:10.834380 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8625cdd-bc90-4807-ac71-06908a6e2203 None admin] RBAC: Adding query filter params (role.id=f89efd1f713043d8835c127de30f53ca, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165, user.id=c1afbf4cd34846de9429d7245b3c886c) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:10.835023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8625cdd-bc90-4807-ac71-06908a6e2203 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:10.836656 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8625cdd-bc90-4807-ac71-06908a6e2203 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:10.842397 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de42ac-d6ca-40fc-9495-13e884db5328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:10.843129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de42ac-d6ca-40fc-9495-13e884db5328 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:10.843522 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de42ac-d6ca-40fc-9495-13e884db5328 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:10.843802 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de42ac-d6ca-40fc-9495-13e884db5328 None admin] PATH_INFO: `/v3/users/c1afbf4cd34846de9429d7245b3c886c` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:10.848212 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de42ac-d6ca-40fc-9495-13e884db5328 None admin] RBAC: Authorizing `identity:get_user(user_id=c1afbf4cd34846de9429d7245b3c886c)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:10.848212 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de42ac-d6ca-40fc-9495-13e884db5328 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:10.848212 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 126/266] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:10 2022] GET /identity/v3/users/c1afbf4cd34846de9429d7245b3c886c => generated 283 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:10.848665 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 140/266] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:10 2022] GET /identity/v3/role_assignments?user.id=c1afbf4cd34846de9429d7245b3c886c&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=f89efd1f713043d8835c127de30f53ca => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:10.853901 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de42ac-d6ca-40fc-9495-13e884db5328 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:10.987180 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:11.008436 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de42ac-d6ca-40fc-9495-13e884db5328 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:11.055638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa40423-1b13-45a8-96e3-dc1adc416468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:11.056254 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa40423-1b13-45a8-96e3-dc1adc416468 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:11.056536 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa40423-1b13-45a8-96e3-dc1adc416468 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:11.057578 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa40423-1b13-45a8-96e3-dc1adc416468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:11.149332 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa40423-1b13-45a8-96e3-dc1adc416468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:11.150910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa40423-1b13-45a8-96e3-dc1adc416468 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:11.255192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:11.282088 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 127/267] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:11.287867 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8625cdd-bc90-4807-ac71-06908a6e2203 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:11.424869 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8625cdd-bc90-4807-ac71-06908a6e2203 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:11.438869 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbe25-c10e-47f0-8eb2-26111ce6df5c None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:11.439186 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbe25-c10e-47f0-8eb2-26111ce6df5c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:11.439433 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbe25-c10e-47f0-8eb2-26111ce6df5c None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:11.440916 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 128/268] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:11.446886 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33184054-192b-4141-8467-4134d5f58717 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:11.447177 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33184054-192b-4141-8467-4134d5f58717 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:11.447992 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33184054-192b-4141-8467-4134d5f58717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:11.473875 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a52fd1-8d31-4a07-a2cb-80b4bd5b12c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:11.474804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52fd1-8d31-4a07-a2cb-80b4bd5b12c7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:11.475250 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52fd1-8d31-4a07-a2cb-80b4bd5b12c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:11.477370 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52fd1-8d31-4a07-a2cb-80b4bd5b12c7 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:11.479244 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a52fd1-8d31-4a07-a2cb-80b4bd5b12c7 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:11.480848 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a52fd1-8d31-4a07-a2cb-80b4bd5b12c7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:11.486836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 141/269] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:11 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:11.487153 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-33184054-192b-4141-8467-4134d5f58717 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:11.488488 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-33184054-192b-4141-8467-4134d5f58717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:11.492993 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a52fd1-8d31-4a07-a2cb-80b4bd5b12c7 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:11.521823 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:11.605701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 129/270] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:11.649324 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a52fd1-8d31-4a07-a2cb-80b4bd5b12c7 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:11.685663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543c3a1-e5b0-47ae-bd03-5e614903f929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:11.686503 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543c3a1-e5b0-47ae-bd03-5e614903f929 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:11.687006 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543c3a1-e5b0-47ae-bd03-5e614903f929 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:11.687420 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543c3a1-e5b0-47ae-bd03-5e614903f929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:11.688425 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543c3a1-e5b0-47ae-bd03-5e614903f929 None admin] RBAC: Adding query filter params (role.id=75e4b5f3154e45059ce3a6449ac4ba3e, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165, user.id=c1afbf4cd34846de9429d7245b3c886c) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:11.688875 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543c3a1-e5b0-47ae-bd03-5e614903f929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:11.690427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543c3a1-e5b0-47ae-bd03-5e614903f929 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:11.697253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 142/271] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:11 2022] GET /identity/v3/role_assignments?user.id=c1afbf4cd34846de9429d7245b3c886c&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=75e4b5f3154e45059ce3a6449ac4ba3e => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:12.028110 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33184054-192b-4141-8467-4134d5f58717 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:12.119336 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c0af6-8b3b-4d05-876f-be5c8727fe84 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.120838 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c0af6-8b3b-4d05-876f-be5c8727fe84 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.121494 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c0af6-8b3b-4d05-876f-be5c8727fe84 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.124761 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 143/272] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:12.128424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d073f71-8e79-4843-ab62-9e5dbd2bc821 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.128809 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d073f71-8e79-4843-ab62-9e5dbd2bc821 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.129092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d073f71-8e79-4843-ab62-9e5dbd2bc821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.140419 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33184054-192b-4141-8467-4134d5f58717 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:12.158190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:12.164097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-8d073f71-8e79-4843-ab62-9e5dbd2bc821 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:12.165314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-8d073f71-8e79-4843-ab62-9e5dbd2bc821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:12.184904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e720909-6094-4a8c-a6f1-0e96950dabfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:12.185604 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e720909-6094-4a8c-a6f1-0e96950dabfa None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.186260 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e720909-6094-4a8c-a6f1-0e96950dabfa None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.186540 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e720909-6094-4a8c-a6f1-0e96950dabfa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.200714 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e720909-6094-4a8c-a6f1-0e96950dabfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-0e720909-6094-4a8c-a6f1-0e96950dabfa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:12.205608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:12.206493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:12.207796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 130/273] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:12.209510 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04197b-6bb3-4a4c-b1d0-65dc84ecee6b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.209510 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04197b-6bb3-4a4c-b1d0-65dc84ecee6b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.210943 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04197b-6bb3-4a4c-b1d0-65dc84ecee6b None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.212470 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 131/274] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:12.216715 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04197b-6bb3-4a4c-b1d0-65dc84ecee6b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:12.255721 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 144/275] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:12.257312 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd0a6b-b78c-4eb1-8355-95dc86510ed0 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.257778 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd0a6b-b78c-4eb1-8355-95dc86510ed0 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.258227 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd0a6b-b78c-4eb1-8355-95dc86510ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.284132 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-04bd0a6b-b78c-4eb1-8355-95dc86510ed0 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:12.285613 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-04bd0a6b-b78c-4eb1-8355-95dc86510ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:12.299759 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:12.335350 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04197b-6bb3-4a4c-b1d0-65dc84ecee6b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:12.360727 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 145/276] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:12.375587 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f9743-d98d-45ad-877b-5a15c5e396e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:12.376411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9743-d98d-45ad-877b-5a15c5e396e1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.376849 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9743-d98d-45ad-877b-5a15c5e396e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.377268 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f9743-d98d-45ad-877b-5a15c5e396e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.378069 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f9743-d98d-45ad-877b-5a15c5e396e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:12.378516 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f9743-d98d-45ad-877b-5a15c5e396e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:12.380067 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f9743-d98d-45ad-877b-5a15c5e396e1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:12.388804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 132/277] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:12.394459 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd0a6b-b78c-4eb1-8355-95dc86510ed0 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:12.499260 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd0a6b-b78c-4eb1-8355-95dc86510ed0 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:12.533743 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385638af-1aa6-4bdc-b24f-6e5e73f8e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:12.534427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385638af-1aa6-4bdc-b24f-6e5e73f8e79e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.534648 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385638af-1aa6-4bdc-b24f-6e5e73f8e79e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.535047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385638af-1aa6-4bdc-b24f-6e5e73f8e79e None admin] PATH_INFO: `/v3/users/ced91250a31e429d93243fa321bc7f16` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.536240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385638af-1aa6-4bdc-b24f-6e5e73f8e79e None admin] RBAC: Authorizing `identity:get_user(user_id=ced91250a31e429d93243fa321bc7f16)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:12.537673 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385638af-1aa6-4bdc-b24f-6e5e73f8e79e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:12.539606 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 146/278] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:12 2022] GET /identity/v3/users/ced91250a31e429d93243fa321bc7f16 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:12.544933 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f9743-d98d-45ad-877b-5a15c5e396e1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:12.585806 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385638af-1aa6-4bdc-b24f-6e5e73f8e79e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:12.588116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:12.599153 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:12.661442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f9743-d98d-45ad-877b-5a15c5e396e1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:12.700792 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385638af-1aa6-4bdc-b24f-6e5e73f8e79e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:12.701661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7df26-6b65-4770-8d1a-e4c2dfe2b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:12.702689 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7df26-6b65-4770-8d1a-e4c2dfe2b73c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.703264 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7df26-6b65-4770-8d1a-e4c2dfe2b73c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.703777 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7df26-6b65-4770-8d1a-e4c2dfe2b73c None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.705266 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7df26-6b65-4770-8d1a-e4c2dfe2b73c None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:12.706960 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7df26-6b65-4770-8d1a-e4c2dfe2b73c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:12.708909 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 133/279] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:12 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:12.715662 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7df26-6b65-4770-8d1a-e4c2dfe2b73c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:12.743023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928dfe8-d191-46ed-93c8-994d3b41484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:12.743651 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928dfe8-d191-46ed-93c8-994d3b41484a None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.743929 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928dfe8-d191-46ed-93c8-994d3b41484a None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.744918 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928dfe8-d191-46ed-93c8-994d3b41484a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.756445 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928dfe8-d191-46ed-93c8-994d3b41484a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-a928dfe8-d191-46ed-93c8-994d3b41484a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:12.762435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:12.763364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 147/280] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:12.768015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928dfe8-d191-46ed-93c8-994d3b41484a None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:12.834131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7df26-6b65-4770-8d1a-e4c2dfe2b73c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:12.835903 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:12.842003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:12.872867 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61474956-7677-4430-9806-bbbbb925313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:12.873330 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474956-7677-4430-9806-bbbbb925313e None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.873611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474956-7677-4430-9806-bbbbb925313e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.873886 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474956-7677-4430-9806-bbbbb925313e None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/users/ced91250a31e429d93243fa321bc7f16/roles/81d6b0f950354b7081637733a86bb6aa` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.875952 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928dfe8-d191-46ed-93c8-994d3b41484a None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:12.876054 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61474956-7677-4430-9806-bbbbb925313e None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5c02b35e89464a8e8356e42fbf5165, user_id=ced91250a31e429d93243fa321bc7f16, role_id=81d6b0f950354b7081637733a86bb6aa)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:12.877586 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61474956-7677-4430-9806-bbbbb925313e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:12.911163 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fb817-ca27-40e4-a2b9-997319d2a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:12.911789 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fb817-ca27-40e4-a2b9-997319d2a272 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:12.912067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fb817-ca27-40e4-a2b9-997319d2a272 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:12.912339 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fb817-ca27-40e4-a2b9-997319d2a272 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:12.913430 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fb817-ca27-40e4-a2b9-997319d2a272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:12.914888 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fb817-ca27-40e4-a2b9-997319d2a272 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:12.916469 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 148/281] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:12.917234 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fb817-ca27-40e4-a2b9-997319d2a272 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:12.942770 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 134/282] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:15:12 2022] PUT /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/users/ced91250a31e429d93243fa321bc7f16/roles/81d6b0f950354b7081637733a86bb6aa => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 18:15:12.943717 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61474956-7677-4430-9806-bbbbb925313e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:13.063968 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fb817-ca27-40e4-a2b9-997319d2a272 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:13.065529 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61474956-7677-4430-9806-bbbbb925313e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:13.107277 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8bbe2-7f75-4a69-884c-83bd47c28dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:13.107869 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8bbe2-7f75-4a69-884c-83bd47c28dff None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:13.108164 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8bbe2-7f75-4a69-884c-83bd47c28dff None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:13.108431 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8bbe2-7f75-4a69-884c-83bd47c28dff None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:13.109223 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8bbe2-7f75-4a69-884c-83bd47c28dff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:13.110814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8bbe2-7f75-4a69-884c-83bd47c28dff None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:13.116171 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5b6e-fea4-4273-be29-cd954298bb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:13.117069 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5b6e-fea4-4273-be29-cd954298bb5d None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:13.117527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5b6e-fea4-4273-be29-cd954298bb5d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:13.118000 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5b6e-fea4-4273-be29-cd954298bb5d None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:13.118894 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab5b6e-fea4-4273-be29-cd954298bb5d None admin] RBAC: Adding query filter params (name=member) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:13.120345 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab5b6e-fea4-4273-be29-cd954298bb5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:13.122689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab5b6e-fea4-4273-be29-cd954298bb5d None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:13.130571 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:13.149053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 149/283] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:13.149053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5b6e-fea4-4273-be29-cd954298bb5d None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:13.251940 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 135/284] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:15:12 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:15:13.254517 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5b6e-fea4-4273-be29-cd954298bb5d None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:13.300596 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5238cc-e6f1-44d2-b77a-68ff75874dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:13.301980 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5238cc-e6f1-44d2-b77a-68ff75874dba None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:13.302415 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5238cc-e6f1-44d2-b77a-68ff75874dba None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:13.302900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5238cc-e6f1-44d2-b77a-68ff75874dba None admin] PATH_INFO: `/v3/users/f957762b78c34b9086c6f18a01c16f31` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:13.319514 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5238cc-e6f1-44d2-b77a-68ff75874dba None admin] RBAC: Authorizing `identity:get_user(user_id=f957762b78c34b9086c6f18a01c16f31)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:13.321380 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5238cc-e6f1-44d2-b77a-68ff75874dba None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:13.323973 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 150/285] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:13 2022] GET /identity/v3/users/f957762b78c34b9086c6f18a01c16f31 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:13.333122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8bbe2-7f75-4a69-884c-83bd47c28dff None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:13.381243 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:13.404663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5f47e-14a8-477f-a24d-14d527a53c72 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:13.404958 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5f47e-14a8-477f-a24d-14d527a53c72 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:13.405220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5f47e-14a8-477f-a24d-14d527a53c72 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:13.406980 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 151/286] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:15:13.412658 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b467aa9-b524-48c5-bce8-8b7318401c60 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:13.412969 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b467aa9-b524-48c5-bce8-8b7318401c60 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:13.413208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b467aa9-b524-48c5-bce8-8b7318401c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:13.433067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-0b467aa9-b524-48c5-bce8-8b7318401c60 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:13.434301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-0b467aa9-b524-48c5-bce8-8b7318401c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:13.452008 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8bbe2-7f75-4a69-884c-83bd47c28dff None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:13.492615 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7c599-487c-4c45-b9b3-d5aa22d7b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:13.494089 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7c599-487c-4c45-b9b3-d5aa22d7b964 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:13.494451 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7c599-487c-4c45-b9b3-d5aa22d7b964 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:13.495317 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7c599-487c-4c45-b9b3-d5aa22d7b964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:13.497171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7c599-487c-4c45-b9b3-d5aa22d7b964 None admin] RBAC: Adding query filter params (role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, user.id=f957762b78c34b9086c6f18a01c16f31, scope.system=all) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:13.497487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7c599-487c-4c45-b9b3-d5aa22d7b964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:13.499739 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7c599-487c-4c45-b9b3-d5aa22d7b964 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:13.503224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:13.506092 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 136/287] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Aug 11 18:15:13 2022] GET /identity/v3/role_assignments?user.id=f957762b78c34b9086c6f18a01c16f31&scope.system=all&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:13.525024 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 152/288] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:13.858020 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7c599-487c-4c45-b9b3-d5aa22d7b964 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:13.973649 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:13.996956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7c599-487c-4c45-b9b3-d5aa22d7b964 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:14.046241 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e0620-4c17-4114-a7f8-27a43c4b9788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:14.047252 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e0620-4c17-4114-a7f8-27a43c4b9788 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:14.047756 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e0620-4c17-4114-a7f8-27a43c4b9788 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:14.048229 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e0620-4c17-4114-a7f8-27a43c4b9788 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:14.060002 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e0620-4c17-4114-a7f8-27a43c4b9788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-b33e0620-4c17-4114-a7f8-27a43c4b9788 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:14.065224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:14.066130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:14.066976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:14.074740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 137/289] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:14.079790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b467aa9-b524-48c5-bce8-8b7318401c60 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:14.247312 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b467aa9-b524-48c5-bce8-8b7318401c60 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:14.296353 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d161d4-8b1b-43c5-b546-a46030ebb143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:14.296971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d161d4-8b1b-43c5-b546-a46030ebb143 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:14.297255 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d161d4-8b1b-43c5-b546-a46030ebb143 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:14.297530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d161d4-8b1b-43c5-b546-a46030ebb143 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:14.298194 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d161d4-8b1b-43c5-b546-a46030ebb143 None admin] RBAC: Adding query filter params (name=member) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:14.298498 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d161d4-8b1b-43c5-b546-a46030ebb143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:14.299895 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d161d4-8b1b-43c5-b546-a46030ebb143 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:14.313617 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 153/290] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:14.319299 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e0620-4c17-4114-a7f8-27a43c4b9788 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:14.475314 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e0620-4c17-4114-a7f8-27a43c4b9788 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:14.513089 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41690fa7-678f-47f4-b0e8-c74bcf767fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:14.513643 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41690fa7-678f-47f4-b0e8-c74bcf767fe2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:14.513920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41690fa7-678f-47f4-b0e8-c74bcf767fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:14.514192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41690fa7-678f-47f4-b0e8-c74bcf767fe2 None admin] PATH_INFO: `/v3/users/a137587b3a10483fb2ef1310709e1277` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:14.519555 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41690fa7-678f-47f4-b0e8-c74bcf767fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=a137587b3a10483fb2ef1310709e1277)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:14.521060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41690fa7-678f-47f4-b0e8-c74bcf767fe2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:14.522643 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 138/291] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:14 2022] GET /identity/v3/users/a137587b3a10483fb2ef1310709e1277 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:14.528819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d161d4-8b1b-43c5-b546-a46030ebb143 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:14.613458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:14.678953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d161d4-8b1b-43c5-b546-a46030ebb143 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:14.723425 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a969a8-3bd9-4a2c-862d-b33ebe3c4838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:14.724089 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a969a8-3bd9-4a2c-862d-b33ebe3c4838 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:14.724370 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a969a8-3bd9-4a2c-862d-b33ebe3c4838 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:14.724642 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a969a8-3bd9-4a2c-862d-b33ebe3c4838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:14.839645 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a969a8-3bd9-4a2c-862d-b33ebe3c4838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:14.841379 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a969a8-3bd9-4a2c-862d-b33ebe3c4838 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:14.914710 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:14.978307 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 154/292] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:14.984019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41690fa7-678f-47f4-b0e8-c74bcf767fe2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:15.003041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:15.133449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41690fa7-678f-47f4-b0e8-c74bcf767fe2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:15.171118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d837f50-84cc-47ad-b546-967c6fbcfc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:15.172121 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837f50-84cc-47ad-b546-967c6fbcfc8e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:15.172608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837f50-84cc-47ad-b546-967c6fbcfc8e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:15.173083 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837f50-84cc-47ad-b546-967c6fbcfc8e None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:15.174444 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d837f50-84cc-47ad-b546-967c6fbcfc8e None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:15.176118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d837f50-84cc-47ad-b546-967c6fbcfc8e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:15.178376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 139/293] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:14 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:15.184773 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a969a8-3bd9-4a2c-862d-b33ebe3c4838 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:15.337409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a969a8-3bd9-4a2c-862d-b33ebe3c4838 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:15.376961 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a939ff3-daff-4cea-b2c3-0a99a334fbcc None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:15.377287 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a939ff3-daff-4cea-b2c3-0a99a334fbcc None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:15.377530 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a939ff3-daff-4cea-b2c3-0a99a334fbcc None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:15.379164 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 140/294] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:15:15.388566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c9b8f-e256-4d85-85a3-64808061d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:15.389105 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c9b8f-e256-4d85-85a3-64808061d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:15.389385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c9b8f-e256-4d85-85a3-64808061d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:15.389656 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c9b8f-e256-4d85-85a3-64808061d6b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:15.390376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c9b8f-e256-4d85-85a3-64808061d6b9 None admin] RBAC: Adding query filter params (role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165, user.id=a137587b3a10483fb2ef1310709e1277) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:15.393670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c9b8f-e256-4d85-85a3-64808061d6b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:15.393670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c9b8f-e256-4d85-85a3-64808061d6b9 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:15.393864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386dece-ca9e-4b18-8616-11f30b0060be None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:15.393864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386dece-ca9e-4b18-8616-11f30b0060be None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:15.393864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386dece-ca9e-4b18-8616-11f30b0060be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:15.398570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 155/295] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:15 2022] GET /identity/v3/role_assignments?user.id=a137587b3a10483fb2ef1310709e1277&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:15.427129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-7386dece-ca9e-4b18-8616-11f30b0060be None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:15.428373 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-7386dece-ca9e-4b18-8616-11f30b0060be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:15.526596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 141/296] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:15.931897 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c9b8f-e256-4d85-85a3-64808061d6b9 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:15.950556 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:16.067465 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c9b8f-e256-4d85-85a3-64808061d6b9 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:16.108893 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdab74-5fbd-4d74-914e-3ca17f82ddb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:16.109531 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdab74-5fbd-4d74-914e-3ca17f82ddb4 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.109812 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdab74-5fbd-4d74-914e-3ca17f82ddb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.110083 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdab74-5fbd-4d74-914e-3ca17f82ddb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.121791 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdab74-5fbd-4d74-914e-3ca17f82ddb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:16.190840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb20f6-8c69-474d-889f-c930654013f5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.191354 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb20f6-8c69-474d-889f-c930654013f5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.191354 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb20f6-8c69-474d-889f-c930654013f5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.194328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 142/297] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:16.199950 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4292f2-3f93-4849-aa9a-d896221d2494 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.200240 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4292f2-3f93-4849-aa9a-d896221d2494 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.200501 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4292f2-3f93-4849-aa9a-d896221d2494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.220189 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1e4292f2-3f93-4849-aa9a-d896221d2494 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:16.221521 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1e4292f2-3f93-4849-aa9a-d896221d2494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:16.231358 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-89fdab74-5fbd-4d74-914e-3ca17f82ddb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:16.250549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:16.251549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:16.252422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 156/298] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:16.258016 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26a73-5a86-4d03-9f17-70f76e538e4d None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.258298 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26a73-5a86-4d03-9f17-70f76e538e4d None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.258594 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26a73-5a86-4d03-9f17-70f76e538e4d None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.260687 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 157/299] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:15:16.261348 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26a73-5a86-4d03-9f17-70f76e538e4d None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:16.302900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 143/300] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:16.302900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5ee18-c592-4704-a9c3-a5971de9ce92 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.302900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5ee18-c592-4704-a9c3-a5971de9ce92 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.302900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5ee18-c592-4704-a9c3-a5971de9ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.380370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-dcc5ee18-c592-4704-a9c3-a5971de9ce92 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:16.380370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-dcc5ee18-c592-4704-a9c3-a5971de9ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:16.380523 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:16.382430 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26a73-5a86-4d03-9f17-70f76e538e4d None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:16.402288 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 144/301] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:16.419406 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23eb8fa-97a8-4baf-98e2-bc8730adfddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:16.420018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eb8fa-97a8-4baf-98e2-bc8730adfddf None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.420303 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eb8fa-97a8-4baf-98e2-bc8730adfddf None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.420629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eb8fa-97a8-4baf-98e2-bc8730adfddf None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.421299 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eb8fa-97a8-4baf-98e2-bc8730adfddf None admin] RBAC: Adding query filter params (name=reader) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:16.421605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eb8fa-97a8-4baf-98e2-bc8730adfddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:16.423094 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eb8fa-97a8-4baf-98e2-bc8730adfddf None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:16.432604 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 158/302] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:16.440066 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5ee18-c592-4704-a9c3-a5971de9ce92 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:16.486919 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa32c-c4c2-4387-b576-aa46e0e80a70 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.487273 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa32c-c4c2-4387-b576-aa46e0e80a70 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.487475 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa32c-c4c2-4387-b576-aa46e0e80a70 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.489044 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 159/303] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:16.493722 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92054-9eb4-4e50-833c-6e7b7e4d7616 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.494002 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92054-9eb4-4e50-833c-6e7b7e4d7616 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.494905 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc92054-9eb4-4e50-833c-6e7b7e4d7616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.510897 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:16.515884 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-5fc92054-9eb4-4e50-833c-6e7b7e4d7616 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:16.517221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-5fc92054-9eb4-4e50-833c-6e7b7e4d7616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:16.545254 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5ee18-c592-4704-a9c3-a5971de9ce92 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:16.584507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2aff6-ab46-4dc6-a7af-4449d56d094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:16.585394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2aff6-ab46-4dc6-a7af-4449d56d094c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.585828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2aff6-ab46-4dc6-a7af-4449d56d094c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.586246 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2aff6-ab46-4dc6-a7af-4449d56d094c None admin] PATH_INFO: `/v3/users/ced91250a31e429d93243fa321bc7f16` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.587675 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2aff6-ab46-4dc6-a7af-4449d56d094c None admin] RBAC: Authorizing `identity:get_user(user_id=ced91250a31e429d93243fa321bc7f16)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:16.590410 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2aff6-ab46-4dc6-a7af-4449d56d094c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:16.592214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 145/304] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:16 2022] GET /identity/v3/users/ced91250a31e429d93243fa321bc7f16 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:16.599359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2aff6-ab46-4dc6-a7af-4449d56d094c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:16.604445 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 160/305] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:16.664607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92054-9eb4-4e50-833c-6e7b7e4d7616 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:16.721376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2aff6-ab46-4dc6-a7af-4449d56d094c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:16.752373 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:16.769070 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352057fe-ffde-4f60-b076-9d6b3ecb577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:16.771383 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352057fe-ffde-4f60-b076-9d6b3ecb577a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.771383 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352057fe-ffde-4f60-b076-9d6b3ecb577a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.771383 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352057fe-ffde-4f60-b076-9d6b3ecb577a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.774490 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:16.796886 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc92054-9eb4-4e50-833c-6e7b7e4d7616 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:16.840375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352057fe-ffde-4f60-b076-9d6b3ecb577a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:16.841831 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352057fe-ffde-4f60-b076-9d6b3ecb577a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:16.842927 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e12b95-dfcb-416c-88da-b74b271af298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:16.843880 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12b95-dfcb-416c-88da-b74b271af298 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:16.844202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12b95-dfcb-416c-88da-b74b271af298 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:16.845342 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12b95-dfcb-416c-88da-b74b271af298 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:16.860354 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e12b95-dfcb-416c-88da-b74b271af298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-64e12b95-dfcb-416c-88da-b74b271af298 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:16.865738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:16.866679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:16.867549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 161/306] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:16.868956 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e12b95-dfcb-416c-88da-b74b271af298 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:16.951386 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 146/307] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 18:15:16.952212 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352057fe-ffde-4f60-b076-9d6b3ecb577a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:16.975633 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e12b95-dfcb-416c-88da-b74b271af298 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:16.986934 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:17.001993 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:17.010509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594a626-3c2c-41ad-b7d4-4803e7554d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.011258 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594a626-3c2c-41ad-b7d4-4803e7554d30 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.011605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594a626-3c2c-41ad-b7d4-4803e7554d30 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.011848 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594a626-3c2c-41ad-b7d4-4803e7554d30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.012952 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594a626-3c2c-41ad-b7d4-4803e7554d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:17.014432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594a626-3c2c-41ad-b7d4-4803e7554d30 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:17.016018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 162/308] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:17.016794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594a626-3c2c-41ad-b7d4-4803e7554d30 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:17.055234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352057fe-ffde-4f60-b076-9d6b3ecb577a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:17.089956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097f4c3-6d4f-4dd8-a849-36354b5d28ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.090556 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097f4c3-6d4f-4dd8-a849-36354b5d28ba None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.090870 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097f4c3-6d4f-4dd8-a849-36354b5d28ba None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.091146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097f4c3-6d4f-4dd8-a849-36354b5d28ba None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.091838 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097f4c3-6d4f-4dd8-a849-36354b5d28ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:17.092139 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097f4c3-6d4f-4dd8-a849-36354b5d28ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:17.093515 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097f4c3-6d4f-4dd8-a849-36354b5d28ba None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:17.101586 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 147/309] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:17.102380 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097f4c3-6d4f-4dd8-a849-36354b5d28ba None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:17.119343 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594a626-3c2c-41ad-b7d4-4803e7554d30 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:17.157190 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2380c2-b9ac-4b55-b993-bc1f69df52f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.157813 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2380c2-b9ac-4b55-b993-bc1f69df52f8 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.158087 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2380c2-b9ac-4b55-b993-bc1f69df52f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.158353 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2380c2-b9ac-4b55-b993-bc1f69df52f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.168202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2380c2-b9ac-4b55-b993-bc1f69df52f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-4d2380c2-b9ac-4b55-b993-bc1f69df52f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:17.173355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:17.174297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 163/310] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:17.179559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2380c2-b9ac-4b55-b993-bc1f69df52f8 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:17.202187 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:17.206043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097f4c3-6d4f-4dd8-a849-36354b5d28ba None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:17.233237 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:17.239119 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b16b2f-e5fe-4d2a-94f8-e75464a61c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.239747 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b16b2f-e5fe-4d2a-94f8-e75464a61c67 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.240030 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b16b2f-e5fe-4d2a-94f8-e75464a61c67 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.240302 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b16b2f-e5fe-4d2a-94f8-e75464a61c67 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.241485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b16b2f-e5fe-4d2a-94f8-e75464a61c67 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:17.243436 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b16b2f-e5fe-4d2a-94f8-e75464a61c67 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:17.246640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 148/311] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:17 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:17.246640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b16b2f-e5fe-4d2a-94f8-e75464a61c67 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:17.293177 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2380c2-b9ac-4b55-b993-bc1f69df52f8 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:17.326655 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed4458-59b4-4eda-8b9e-43194520bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.327285 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed4458-59b4-4eda-8b9e-43194520bf77 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.327565 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed4458-59b4-4eda-8b9e-43194520bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.327838 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed4458-59b4-4eda-8b9e-43194520bf77 None admin] PATH_INFO: `/v3/groups` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.328457 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed4458-59b4-4eda-8b9e-43194520bf77 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:17.329883 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed4458-59b4-4eda-8b9e-43194520bf77 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:17.350887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b16b2f-e5fe-4d2a-94f8-e75464a61c67 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:17.384477 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f669fd-a899-476e-a475-1aef2714e543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.386749 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f669fd-a899-476e-a475-1aef2714e543 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.387037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f669fd-a899-476e-a475-1aef2714e543 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.387316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f669fd-a899-476e-a475-1aef2714e543 None admin] PATH_INFO: `/v3/users/74f4b608c18640e18ddead0379e3e7de` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.393123 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 164/312] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Aug 11 18:15:17 2022] POST /identity/v3/groups => generated 229 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:15:17.394507 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed4458-59b4-4eda-8b9e-43194520bf77 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:17.404031 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f669fd-a899-476e-a475-1aef2714e543 None admin] RBAC: Authorizing `identity:get_user(user_id=74f4b608c18640e18ddead0379e3e7de)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:17.405547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f669fd-a899-476e-a475-1aef2714e543 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:17.412827 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 149/313] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:17 2022] GET /identity/v3/users/74f4b608c18640e18ddead0379e3e7de => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:17.413956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f669fd-a899-476e-a475-1aef2714e543 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:17.450951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:17.550907 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f669fd-a899-476e-a475-1aef2714e543 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:17.564123 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed4458-59b4-4eda-8b9e-43194520bf77 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:17.583203 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:17.591381 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c1552-76e6-4783-ae10-351ea5525a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.592263 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1552-76e6-4783-ae10-351ea5525a64 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.592738 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1552-76e6-4783-ae10-351ea5525a64 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.593020 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1552-76e6-4783-ae10-351ea5525a64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.593751 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c1552-76e6-4783-ae10-351ea5525a64 None admin] RBAC: Adding query filter params (role.id=81d6b0f950354b7081637733a86bb6aa, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165, user.id=ced91250a31e429d93243fa321bc7f16) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:17.594062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c1552-76e6-4783-ae10-351ea5525a64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:17.596151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c1552-76e6-4783-ae10-351ea5525a64 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:17.602088 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 150/314] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:17 2022] GET /identity/v3/role_assignments?user.id=ced91250a31e429d93243fa321bc7f16&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=81d6b0f950354b7081637733a86bb6aa => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:17.602854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c1552-76e6-4783-ae10-351ea5525a64 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:17.611881 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e73858-c42d-432b-97ba-3e73730c76f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.612607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e73858-c42d-432b-97ba-3e73730c76f4 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.612892 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e73858-c42d-432b-97ba-3e73730c76f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.613170 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e73858-c42d-432b-97ba-3e73730c76f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.613862 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e73858-c42d-432b-97ba-3e73730c76f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:17.614179 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e73858-c42d-432b-97ba-3e73730c76f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:17.616425 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e73858-c42d-432b-97ba-3e73730c76f4 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:17.631589 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 165/315] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:17.640758 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e73858-c42d-432b-97ba-3e73730c76f4 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:17.738904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:17.755601 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c1552-76e6-4783-ae10-351ea5525a64 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:17.767729 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e73858-c42d-432b-97ba-3e73730c76f4 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:17.800694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb8f1e-2d7c-4c01-a0c1-e25cb7caaab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.801822 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb8f1e-2d7c-4c01-a0c1-e25cb7caaab2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.802421 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb8f1e-2d7c-4c01-a0c1-e25cb7caaab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.802927 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb8f1e-2d7c-4c01-a0c1-e25cb7caaab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.803864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb8f1e-2d7c-4c01-a0c1-e25cb7caaab2 None admin] RBAC: Adding query filter params (role.id=81d6b0f950354b7081637733a86bb6aa, user.id=74f4b608c18640e18ddead0379e3e7de, scope.system=all) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:17.804376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb8f1e-2d7c-4c01-a0c1-e25cb7caaab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:17.806346 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb8f1e-2d7c-4c01-a0c1-e25cb7caaab2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:17.812836 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 151/316] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Aug 11 18:15:17 2022] GET /identity/v3/role_assignments?user.id=74f4b608c18640e18ddead0379e3e7de&scope.system=all&role.id=81d6b0f950354b7081637733a86bb6aa => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:17.820101 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058e2d5-a97f-4458-8768-9aa6ca0ff564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.820101 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058e2d5-a97f-4458-8768-9aa6ca0ff564 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.820101 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058e2d5-a97f-4458-8768-9aa6ca0ff564 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.820101 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058e2d5-a97f-4458-8768-9aa6ca0ff564 None admin] PATH_INFO: `/v3/users/f957762b78c34b9086c6f18a01c16f31` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.820510 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058e2d5-a97f-4458-8768-9aa6ca0ff564 None admin] RBAC: Authorizing `identity:get_user(user_id=f957762b78c34b9086c6f18a01c16f31)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:17.820510 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058e2d5-a97f-4458-8768-9aa6ca0ff564 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:17.820510 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 166/317] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:17 2022] GET /identity/v3/users/f957762b78c34b9086c6f18a01c16f31 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:17.826902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb8f1e-2d7c-4c01-a0c1-e25cb7caaab2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:17.952800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb8f1e-2d7c-4c01-a0c1-e25cb7caaab2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:17.991553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e27f37-f5d4-440c-bc2f-e67cf039023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:17.992221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e27f37-f5d4-440c-bc2f-e67cf039023c None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:17.992500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e27f37-f5d4-440c-bc2f-e67cf039023c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:17.992774 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e27f37-f5d4-440c-bc2f-e67cf039023c None admin] PATH_INFO: `/v3/system/users/f957762b78c34b9086c6f18a01c16f31/roles/1e94f00bf0f044b89bc9bd8dab18e2fa` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:17.995048 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e27f37-f5d4-440c-bc2f-e67cf039023c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f957762b78c34b9086c6f18a01c16f31, role_id=1e94f00bf0f044b89bc9bd8dab18e2fa)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:17.996452 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e27f37-f5d4-440c-bc2f-e67cf039023c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:18.090568 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 152/318] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Aug 11 18:15:17 2022] PUT /identity/v3/system/users/f957762b78c34b9086c6f18a01c16f31/roles/1e94f00bf0f044b89bc9bd8dab18e2fa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:19.697682 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d6d7c-35c7-4e15-b139-abf6e7191e66 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:19.698204 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d6d7c-35c7-4e15-b139-abf6e7191e66 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:19.698204 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d6d7c-35c7-4e15-b139-abf6e7191e66 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:19.699619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 167/319] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:19.704961 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2705ab5-d27d-49ec-8dd3-0aa2faffc7ae None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:19.705365 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2705ab5-d27d-49ec-8dd3-0aa2faffc7ae None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:19.705527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2705ab5-d27d-49ec-8dd3-0aa2faffc7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:19.724466 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-a2705ab5-d27d-49ec-8dd3-0aa2faffc7ae None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:19.725654 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-a2705ab5-d27d-49ec-8dd3-0aa2faffc7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:19.738139 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:19.801588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 153/320] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:19.986090 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357a04-6af0-4abc-b95c-2b683b300d70 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:19.986370 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357a04-6af0-4abc-b95c-2b683b300d70 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:19.986861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357a04-6af0-4abc-b95c-2b683b300d70 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:19.988204 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 168/321] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:19.993592 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30388597-63a2-4ad0-a858-af6c22ec3e0b None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:19.993904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30388597-63a2-4ad0-a858-af6c22ec3e0b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:19.994174 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30388597-63a2-4ad0-a858-af6c22ec3e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:20.012107 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-30388597-63a2-4ad0-a858-af6c22ec3e0b None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:20.013278 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-30388597-63a2-4ad0-a858-af6c22ec3e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:20.080475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 154/322] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:20.137347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1357a04-6af0-4abc-b95c-2b683b300d70 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:20.185535 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:20.241271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1357a04-6af0-4abc-b95c-2b683b300d70 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:20.276265 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798179c4-b410-4db9-8b26-5bfa1f724783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:20.276890 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798179c4-b410-4db9-8b26-5bfa1f724783 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:20.277168 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798179c4-b410-4db9-8b26-5bfa1f724783 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:20.277439 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798179c4-b410-4db9-8b26-5bfa1f724783 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:20.278532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798179c4-b410-4db9-8b26-5bfa1f724783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:20.280067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798179c4-b410-4db9-8b26-5bfa1f724783 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:20.281846 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 169/323] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:20.282322 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957715a-521a-4622-85fc-5683430084ad None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:20.282609 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957715a-521a-4622-85fc-5683430084ad None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:20.282935 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957715a-521a-4622-85fc-5683430084ad None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:20.284378 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 155/324] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:20.288100 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798179c4-b410-4db9-8b26-5bfa1f724783 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:20.288936 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be87e-2c60-4081-81ec-e34dffc8b8b2 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:20.289223 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be87e-2c60-4081-81ec-e34dffc8b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:20.289503 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be87e-2c60-4081-81ec-e34dffc8b8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:20.308570 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c37be87e-2c60-4081-81ec-e34dffc8b8b2 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:20.309760 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c37be87e-2c60-4081-81ec-e34dffc8b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:20.382705 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 156/325] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:20.401911 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37be87e-2c60-4081-81ec-e34dffc8b8b2 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:20.403784 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798179c4-b410-4db9-8b26-5bfa1f724783 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:20.410918 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:20.420695 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:20.440877 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f5811-0810-4aa6-9405-d8bb80f47d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:20.441772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f5811-0810-4aa6-9405-d8bb80f47d74 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:20.442261 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f5811-0810-4aa6-9405-d8bb80f47d74 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:20.442759 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f5811-0810-4aa6-9405-d8bb80f47d74 None admin] PATH_INFO: `/v3/groups` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:20.443584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f5811-0810-4aa6-9405-d8bb80f47d74 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:20.445197 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f5811-0810-4aa6-9405-d8bb80f47d74 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:20.504066 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37be87e-2c60-4081-81ec-e34dffc8b8b2 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:20.538192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6fcb6-3e36-41b8-a81a-45ac34165b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:20.538848 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6fcb6-3e36-41b8-a81a-45ac34165b5c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:20.539132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6fcb6-3e36-41b8-a81a-45ac34165b5c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:20.539404 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6fcb6-3e36-41b8-a81a-45ac34165b5c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:20.545892 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 170/326] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Aug 11 18:15:20 2022] POST /identity/v3/groups => generated 226 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:15:20.551345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6fcb6-3e36-41b8-a81a-45ac34165b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-1fe6fcb6-3e36-41b8-a81a-45ac34165b5c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:20.556942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:20.557939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:20.559591 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 157/327] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:20.564367 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f5811-0810-4aa6-9405-d8bb80f47d74 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:20.674305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f5811-0810-4aa6-9405-d8bb80f47d74 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:20.711080 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f00e15-b4dd-4cd5-823c-9bfee516939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:20.711861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f00e15-b4dd-4cd5-823c-9bfee516939c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:20.712077 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f00e15-b4dd-4cd5-823c-9bfee516939c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:20.712338 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f00e15-b4dd-4cd5-823c-9bfee516939c None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:20.713566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f00e15-b4dd-4cd5-823c-9bfee516939c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:20.714068 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f00e15-b4dd-4cd5-823c-9bfee516939c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:20.715498 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f00e15-b4dd-4cd5-823c-9bfee516939c None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:20.730190 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 171/328] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:20.731278 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6fcb6-3e36-41b8-a81a-45ac34165b5c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:20.733608 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f00e15-b4dd-4cd5-823c-9bfee516939c None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:20.776531 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:20.809597 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:20.853621 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6fcb6-3e36-41b8-a81a-45ac34165b5c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:20.862389 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f00e15-b4dd-4cd5-823c-9bfee516939c None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:20.908101 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b4b14-ae0c-4c80-beec-1da32cac05fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:20.909092 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b4b14-ae0c-4c80-beec-1da32cac05fb None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:20.909370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b4b14-ae0c-4c80-beec-1da32cac05fb None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:20.909640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b4b14-ae0c-4c80-beec-1da32cac05fb None admin] PATH_INFO: `/v3/users/74f4b608c18640e18ddead0379e3e7de` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:20.910800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b4b14-ae0c-4c80-beec-1da32cac05fb None admin] RBAC: Authorizing `identity:get_user(user_id=74f4b608c18640e18ddead0379e3e7de)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:20.912247 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b4b14-ae0c-4c80-beec-1da32cac05fb None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:20.912969 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a05659-def6-4f0a-97fe-48a5db36703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:20.913799 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a05659-def6-4f0a-97fe-48a5db36703c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:20.913913 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 158/329] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:20 2022] GET /identity/v3/users/74f4b608c18640e18ddead0379e3e7de => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:20.914359 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a05659-def6-4f0a-97fe-48a5db36703c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:20.914804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a05659-def6-4f0a-97fe-48a5db36703c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:20.920174 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b4b14-ae0c-4c80-beec-1da32cac05fb None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:20.930808 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a05659-def6-4f0a-97fe-48a5db36703c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-82a05659-def6-4f0a-97fe-48a5db36703c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:20.938487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:20.939438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:20.940240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 172/330] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:20.945595 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a05659-def6-4f0a-97fe-48a5db36703c None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:21.059723 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b4b14-ae0c-4c80-beec-1da32cac05fb None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:21.074693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:21.079459 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a05659-def6-4f0a-97fe-48a5db36703c None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:21.118146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f865132-3075-4384-9f5a-b17a38debb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:21.119548 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f865132-3075-4384-9f5a-b17a38debb9a None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:21.120152 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f865132-3075-4384-9f5a-b17a38debb9a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:21.120386 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f865132-3075-4384-9f5a-b17a38debb9a None admin] PATH_INFO: `/v3/system/users/74f4b608c18640e18ddead0379e3e7de/roles/81d6b0f950354b7081637733a86bb6aa` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:21.122325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f865132-3075-4384-9f5a-b17a38debb9a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=74f4b608c18640e18ddead0379e3e7de, role_id=81d6b0f950354b7081637733a86bb6aa)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:21.123957 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f865132-3075-4384-9f5a-b17a38debb9a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:21.129011 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d2a6-700b-4aae-adc1-ad493bac3956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:21.129011 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d2a6-700b-4aae-adc1-ad493bac3956 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:21.129011 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d2a6-700b-4aae-adc1-ad493bac3956 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:21.129011 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d2a6-700b-4aae-adc1-ad493bac3956 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:21.129468 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7d2a6-700b-4aae-adc1-ad493bac3956 None admin] RBAC: Adding query filter params (name=member) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:21.129468 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7d2a6-700b-4aae-adc1-ad493bac3956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:21.129983 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:21.131413 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7d2a6-700b-4aae-adc1-ad493bac3956 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:21.141641 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 173/331] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:21.147114 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d2a6-700b-4aae-adc1-ad493bac3956 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:21.227468 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 159/332] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Aug 11 18:15:20 2022] PUT /identity/v3/system/users/74f4b608c18640e18ddead0379e3e7de/roles/81d6b0f950354b7081637733a86bb6aa => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 18:15:21.263921 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d2a6-700b-4aae-adc1-ad493bac3956 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:21.302401 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b9efb-42bd-464d-8c87-00611471e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:21.303212 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b9efb-42bd-464d-8c87-00611471e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:21.303495 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b9efb-42bd-464d-8c87-00611471e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:21.303770 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b9efb-42bd-464d-8c87-00611471e5e0 None admin] PATH_INFO: `/v3/users/f957762b78c34b9086c6f18a01c16f31` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:21.304933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b9efb-42bd-464d-8c87-00611471e5e0 None admin] RBAC: Authorizing `identity:get_user(user_id=f957762b78c34b9086c6f18a01c16f31)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:21.307353 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b9efb-42bd-464d-8c87-00611471e5e0 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:21.312868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 174/333] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:21 2022] GET /identity/v3/users/f957762b78c34b9086c6f18a01c16f31 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:21.315780 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f865132-3075-4384-9f5a-b17a38debb9a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:21.439399 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f865132-3075-4384-9f5a-b17a38debb9a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:21.486019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1542199-52c0-4e20-a044-6c4d98047a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:21.486628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1542199-52c0-4e20-a044-6c4d98047a6e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:21.486954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1542199-52c0-4e20-a044-6c4d98047a6e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:21.487223 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1542199-52c0-4e20-a044-6c4d98047a6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:21.487945 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1542199-52c0-4e20-a044-6c4d98047a6e None admin] RBAC: Adding query filter params (role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, user.id=f957762b78c34b9086c6f18a01c16f31, scope.system=all) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:21.488247 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1542199-52c0-4e20-a044-6c4d98047a6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:21.489680 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1542199-52c0-4e20-a044-6c4d98047a6e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:21.505662 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 160/334] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Aug 11 18:15:21 2022] GET /identity/v3/role_assignments?user.id=f957762b78c34b9086c6f18a01c16f31&scope.system=all&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:23.082430 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b91e8e-6a74-4873-bd84-b130af225134 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:23.083006 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b91e8e-6a74-4873-bd84-b130af225134 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:23.083006 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b91e8e-6a74-4873-bd84-b130af225134 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:23.084516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 175/335] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:23.089756 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad1259-b22b-48d1-945d-a685e3eb6932 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:23.090167 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad1259-b22b-48d1-945d-a685e3eb6932 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:23.090367 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad1259-b22b-48d1-945d-a685e3eb6932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:23.113336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-0bad1259-b22b-48d1-945d-a685e3eb6932 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:23.114538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-0bad1259-b22b-48d1-945d-a685e3eb6932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:23.184479 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:23.202699 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 161/336] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:23.875375 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b91e8e-6a74-4873-bd84-b130af225134 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:23.909486 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:24.020255 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b91e8e-6a74-4873-bd84-b130af225134 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:24.066177 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2b9f8-170c-4906-9c98-ec07b9c981ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:24.066865 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2b9f8-170c-4906-9c98-ec07b9c981ba None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:24.067148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2b9f8-170c-4906-9c98-ec07b9c981ba None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:24.067423 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2b9f8-170c-4906-9c98-ec07b9c981ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:24.084404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2b9f8-170c-4906-9c98-ec07b9c981ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:24.090535 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7261bf-17b4-4a7c-ab55-3e4a7e895fc5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:24.090995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7261bf-17b4-4a7c-ab55-3e4a7e895fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:24.091186 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7261bf-17b4-4a7c-ab55-3e4a7e895fc5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:24.092606 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 162/337] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-92e2b9f8-170c-4906-9c98-ec07b9c981ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:24.093508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:24.094432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:24.098315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:24.099519 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 176/338] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:24.100553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816eba0-55b7-42c3-901c-670ccc740528 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:24.100845 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816eba0-55b7-42c3-901c-670ccc740528 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:24.101122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816eba0-55b7-42c3-901c-670ccc740528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:24.109125 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2b9f8-170c-4906-9c98-ec07b9c981ba None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:24.128991 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-2816eba0-55b7-42c3-901c-670ccc740528 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:24.130972 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-2816eba0-55b7-42c3-901c-670ccc740528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:24.226689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:24.229531 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 163/339] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:24.246606 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2b9f8-170c-4906-9c98-ec07b9c981ba None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:24.294621 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d23cf3-8392-4fb3-8e20-decee5feda2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:24.295245 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23cf3-8392-4fb3-8e20-decee5feda2f None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:24.295533 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23cf3-8392-4fb3-8e20-decee5feda2f None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:24.295807 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23cf3-8392-4fb3-8e20-decee5feda2f None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:24.296534 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d23cf3-8392-4fb3-8e20-decee5feda2f None admin] RBAC: Adding query filter params (name=member) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:24.296841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d23cf3-8392-4fb3-8e20-decee5feda2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:24.298213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d23cf3-8392-4fb3-8e20-decee5feda2f None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:24.309307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d85d8-5389-44b4-9530-a0964485f7a1 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:24.310149 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d85d8-5389-44b4-9530-a0964485f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:24.312267 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 177/340] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:24.312820 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d85d8-5389-44b4-9530-a0964485f7a1 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:24.314857 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 164/341] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:24.320783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d23cf3-8392-4fb3-8e20-decee5feda2f None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:24.341208 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f3301-b152-4e3e-91a0-8cb3d5028d58 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:24.341859 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f3301-b152-4e3e-91a0-8cb3d5028d58 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:24.342342 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f3301-b152-4e3e-91a0-8cb3d5028d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:24.371388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-948f3301-b152-4e3e-91a0-8cb3d5028d58 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:24.373658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-948f3301-b152-4e3e-91a0-8cb3d5028d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:24.486177 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d23cf3-8392-4fb3-8e20-decee5feda2f None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:24.536607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432f4fc-8c1e-47cf-8ba9-f24e2a6881c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:24.538839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432f4fc-8c1e-47cf-8ba9-f24e2a6881c0 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:24.540289 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432f4fc-8c1e-47cf-8ba9-f24e2a6881c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:24.540789 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432f4fc-8c1e-47cf-8ba9-f24e2a6881c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:24.563478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:24.568157 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 165/342] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:24.569483 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865fe38-1f97-40a5-9270-49639b93dbba None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:24.569772 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865fe38-1f97-40a5-9270-49639b93dbba None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:24.570050 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865fe38-1f97-40a5-9270-49639b93dbba None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:24.571432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 166/343] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:24.579942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1ec17-2bc7-4890-b4f9-007f01a5e1b6 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:24.581426 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1ec17-2bc7-4890-b4f9-007f01a5e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:24.581426 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1ec17-2bc7-4890-b4f9-007f01a5e1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:24.623738 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-93d1ec17-2bc7-4890-b4f9-007f01a5e1b6 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:24.625538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-93d1ec17-2bc7-4890-b4f9-007f01a5e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:24.633500 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432f4fc-8c1e-47cf-8ba9-f24e2a6881c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:24.635344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432f4fc-8c1e-47cf-8ba9-f24e2a6881c0 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:24.714068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:24.770471 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 167/344] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:24.771229 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1ec17-2bc7-4890-b4f9-007f01a5e1b6 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:24.805682 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 178/345] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:24.812005 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432f4fc-8c1e-47cf-8ba9-f24e2a6881c0 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:24.867218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:24.927895 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432f4fc-8c1e-47cf-8ba9-f24e2a6881c0 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:24.966104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd742ff-f2b2-4d46-a78f-47ec07a41f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:24.967184 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd742ff-f2b2-4d46-a78f-47ec07a41f31 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:24.967763 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd742ff-f2b2-4d46-a78f-47ec07a41f31 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:24.968185 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd742ff-f2b2-4d46-a78f-47ec07a41f31 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:24.969846 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd742ff-f2b2-4d46-a78f-47ec07a41f31 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:24.971656 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd742ff-f2b2-4d46-a78f-47ec07a41f31 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:24.973751 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 179/346] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:24 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:24.979898 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd742ff-f2b2-4d46-a78f-47ec07a41f31 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:25.010896 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1ec17-2bc7-4890-b4f9-007f01a5e1b6 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:25.094219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd742ff-f2b2-4d46-a78f-47ec07a41f31 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:25.108009 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641870d-ddd3-43db-a4dd-b37cb6688996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:25.109294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641870d-ddd3-43db-a4dd-b37cb6688996 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.109729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641870d-ddd3-43db-a4dd-b37cb6688996 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.110163 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641870d-ddd3-43db-a4dd-b37cb6688996 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.114733 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:25.135062 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6062cc-6c3e-468e-9b9d-da0a73d2f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:25.135619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6062cc-6c3e-468e-9b9d-da0a73d2f8dc None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.135899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6062cc-6c3e-468e-9b9d-da0a73d2f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.138728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6062cc-6c3e-468e-9b9d-da0a73d2f8dc None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.144057 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6062cc-6c3e-468e-9b9d-da0a73d2f8dc None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:25.145812 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6062cc-6c3e-468e-9b9d-da0a73d2f8dc None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:25.147847 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 180/347] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:24 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:25.148683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6062cc-6c3e-468e-9b9d-da0a73d2f8dc None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:25.151437 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641870d-ddd3-43db-a4dd-b37cb6688996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-9641870d-ddd3-43db-a4dd-b37cb6688996 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:25.156484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:25.157394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:25.158596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 168/348] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:25.163585 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641870d-ddd3-43db-a4dd-b37cb6688996 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:25.268914 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6062cc-6c3e-468e-9b9d-da0a73d2f8dc None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:25.287764 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:25.306684 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618f83b-bd04-4618-b2d9-56cd8a916290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:25.307657 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618f83b-bd04-4618-b2d9-56cd8a916290 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.307947 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618f83b-bd04-4618-b2d9-56cd8a916290 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.308223 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618f83b-bd04-4618-b2d9-56cd8a916290 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.320894 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618f83b-bd04-4618-b2d9-56cd8a916290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-b618f83b-bd04-4618-b2d9-56cd8a916290 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:25.327991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:25.328967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:25.329861 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 181/349] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:15:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:25.330567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618f83b-bd04-4618-b2d9-56cd8a916290 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:25.375047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:25.382064 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641870d-ddd3-43db-a4dd-b37cb6688996 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:25.427384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ca00c-64b0-4a65-b596-7346b209499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:25.427909 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ca00c-64b0-4a65-b596-7346b209499f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.428191 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ca00c-64b0-4a65-b596-7346b209499f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.428464 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ca00c-64b0-4a65-b596-7346b209499f None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.429131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ca00c-64b0-4a65-b596-7346b209499f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:25.429812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ca00c-64b0-4a65-b596-7346b209499f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:25.431403 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ca00c-64b0-4a65-b596-7346b209499f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:25.441325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 169/350] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:25.442466 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ca00c-64b0-4a65-b596-7346b209499f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:25.452638 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618f83b-bd04-4618-b2d9-56cd8a916290 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:25.494548 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97d215-d0c5-407f-ab23-c6292ace1c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:25.495355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d215-d0c5-407f-ab23-c6292ace1c8a None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.495639 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d215-d0c5-407f-ab23-c6292ace1c8a None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.495920 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d215-d0c5-407f-ab23-c6292ace1c8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.496647 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97d215-d0c5-407f-ab23-c6292ace1c8a None admin] RBAC: Adding query filter params (group.id=c85c4d8261804b6aa09acd8350f37f27, role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:25.496960 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97d215-d0c5-407f-ab23-c6292ace1c8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:25.499687 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97d215-d0c5-407f-ab23-c6292ace1c8a None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:25.506067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 182/351] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 11 18:15:25 2022] GET /identity/v3/role_assignments?group.id=c85c4d8261804b6aa09acd8350f37f27&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:25.506753 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97d215-d0c5-407f-ab23-c6292ace1c8a None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:25.594462 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:25.599410 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ca00c-64b0-4a65-b596-7346b209499f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:25.642062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ac693-b6c2-411d-b6ce-65372fd33c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:25.643315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ac693-b6c2-411d-b6ce-65372fd33c60 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.643897 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ac693-b6c2-411d-b6ce-65372fd33c60 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.644484 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ac693-b6c2-411d-b6ce-65372fd33c60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.651444 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97d215-d0c5-407f-ab23-c6292ace1c8a None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:25.653110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:25.658966 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ac693-b6c2-411d-b6ce-65372fd33c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-c21ac693-b6c2-411d-b6ce-65372fd33c60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:25.664401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:25.668347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:25.669359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 170/352] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:25.670342 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2328265-4654-4f3e-add1-4da422203daa None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.670862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2328265-4654-4f3e-add1-4da422203daa None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.671013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2328265-4654-4f3e-add1-4da422203daa None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.672795 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 171/353] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:25.673661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2328265-4654-4f3e-add1-4da422203daa None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:25.698253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2a27b-112c-42dd-b7a2-d1cf01b8d954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:25.698816 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2a27b-112c-42dd-b7a2-d1cf01b8d954 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.699098 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2a27b-112c-42dd-b7a2-d1cf01b8d954 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.699372 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2a27b-112c-42dd-b7a2-d1cf01b8d954 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.700151 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2a27b-112c-42dd-b7a2-d1cf01b8d954 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:25.700463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2a27b-112c-42dd-b7a2-d1cf01b8d954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:25.701971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2a27b-112c-42dd-b7a2-d1cf01b8d954 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:25.712860 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 183/354] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:25.713553 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2a27b-112c-42dd-b7a2-d1cf01b8d954 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:25.808173 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2328265-4654-4f3e-add1-4da422203daa None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:25.849720 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2b6e0-ebf9-4773-9aad-2346369f8977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:25.850457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2b6e0-ebf9-4773-9aad-2346369f8977 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.850885 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2b6e0-ebf9-4773-9aad-2346369f8977 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.851271 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2b6e0-ebf9-4773-9aad-2346369f8977 None admin] PATH_INFO: `/v3/users/74f4b608c18640e18ddead0379e3e7de` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.852618 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2b6e0-ebf9-4773-9aad-2346369f8977 None admin] RBAC: Authorizing `identity:get_user(user_id=74f4b608c18640e18ddead0379e3e7de)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:25.854265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2b6e0-ebf9-4773-9aad-2346369f8977 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:25.856311 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 172/355] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Aug 11 18:15:25 2022] GET /identity/v3/users/74f4b608c18640e18ddead0379e3e7de => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:25.861548 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5413dc-85ec-4a34-8d87-314965ab098f None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.861548 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5413dc-85ec-4a34-8d87-314965ab098f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.861548 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5413dc-85ec-4a34-8d87-314965ab098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.861818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2a27b-112c-42dd-b7a2-d1cf01b8d954 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:25.879915 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6c5413dc-85ec-4a34-8d87-314965ab098f None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:25.881412 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6c5413dc-85ec-4a34-8d87-314965ab098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:25.906126 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72fd6f-9680-458e-977d-389807019709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:25.906938 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72fd6f-9680-458e-977d-389807019709 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:25.907324 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72fd6f-9680-458e-977d-389807019709 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:25.907701 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72fd6f-9680-458e-977d-389807019709 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:25.908534 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72fd6f-9680-458e-977d-389807019709 None admin] RBAC: Adding query filter params (name=member) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:25.909039 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72fd6f-9680-458e-977d-389807019709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:25.910053 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:25.910691 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72fd6f-9680-458e-977d-389807019709 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:25.925117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 184/356] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:25.935470 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72fd6f-9680-458e-977d-389807019709 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:25.964047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:25.981344 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 173/357] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:25.982306 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5413dc-85ec-4a34-8d87-314965ab098f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:26.092844 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72fd6f-9680-458e-977d-389807019709 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:26.101343 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5413dc-85ec-4a34-8d87-314965ab098f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:26.141659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e560645-acf4-4417-abbf-d142f504938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:26.143144 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560645-acf4-4417-abbf-d142f504938b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:26.143624 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560645-acf4-4417-abbf-d142f504938b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:26.144089 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560645-acf4-4417-abbf-d142f504938b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:26.161306 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def81d5-189c-4e9d-bc6d-4e8a5dbbb78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:26.162183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def81d5-189c-4e9d-bc6d-4e8a5dbbb78d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:26.162542 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def81d5-189c-4e9d-bc6d-4e8a5dbbb78d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:26.162930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def81d5-189c-4e9d-bc6d-4e8a5dbbb78d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:26.163740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def81d5-189c-4e9d-bc6d-4e8a5dbbb78d None admin] RBAC: Adding query filter params (role.id=81d6b0f950354b7081637733a86bb6aa, user.id=74f4b608c18640e18ddead0379e3e7de, scope.system=all) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:26.164480 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def81d5-189c-4e9d-bc6d-4e8a5dbbb78d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:26.167689 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def81d5-189c-4e9d-bc6d-4e8a5dbbb78d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:26.188202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 174/358] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Aug 11 18:15:25 2022] GET /identity/v3/role_assignments?user.id=74f4b608c18640e18ddead0379e3e7de&scope.system=all&role.id=81d6b0f950354b7081637733a86bb6aa => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:26.189368 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def81d5-189c-4e9d-bc6d-4e8a5dbbb78d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:26.214783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:26.249857 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e560645-acf4-4417-abbf-d142f504938b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:26.251916 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e560645-acf4-4417-abbf-d142f504938b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:26.289045 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:26.320573 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def81d5-189c-4e9d-bc6d-4e8a5dbbb78d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:26.362047 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e597779-e587-468a-80eb-318a8c9befe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:26.363129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e597779-e587-468a-80eb-318a8c9befe8 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:26.363689 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e597779-e587-468a-80eb-318a8c9befe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:26.364191 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e597779-e587-468a-80eb-318a8c9befe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:26.391525 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 185/359] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:26.393534 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02472a0-2f85-4c35-8c9e-85d02d1f0562 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:26.394086 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02472a0-2f85-4c35-8c9e-85d02d1f0562 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:26.394568 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02472a0-2f85-4c35-8c9e-85d02d1f0562 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:26.400819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 186/360] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:26.402267 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02472a0-2f85-4c35-8c9e-85d02d1f0562 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:26.463360 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e597779-e587-468a-80eb-318a8c9befe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:26.464910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e597779-e587-468a-80eb-318a8c9befe8 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:26.483693 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:26.527567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02472a0-2f85-4c35-8c9e-85d02d1f0562 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:26.565474 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:26.577260 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e534f2-8063-4010-9a68-3f9882a6c370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:26.578305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e534f2-8063-4010-9a68-3f9882a6c370 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:26.578777 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e534f2-8063-4010-9a68-3f9882a6c370 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:26.579363 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e534f2-8063-4010-9a68-3f9882a6c370 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:26.580619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e534f2-8063-4010-9a68-3f9882a6c370 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:26.582300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e534f2-8063-4010-9a68-3f9882a6c370 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:26.584513 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 187/361] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:26 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:26.587297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc873f34-7c81-48f8-9bc0-ce42a2012793 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:26.587540 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc873f34-7c81-48f8-9bc0-ce42a2012793 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:26.587819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc873f34-7c81-48f8-9bc0-ce42a2012793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:26.609732 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-dc873f34-7c81-48f8-9bc0-ce42a2012793 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:26.609932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 175/362] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:26.609932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e597779-e587-468a-80eb-318a8c9befe8 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:26.610078 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-dc873f34-7c81-48f8-9bc0-ce42a2012793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:26.719390 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 188/363] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:26.720671 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc873f34-7c81-48f8-9bc0-ce42a2012793 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:26.758586 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e597779-e587-468a-80eb-318a8c9befe8 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:26.774727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:26.803723 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f95718-4ca3-4ccf-ae03-42b161299c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:26.804625 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f95718-4ca3-4ccf-ae03-42b161299c31 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:26.805055 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f95718-4ca3-4ccf-ae03-42b161299c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:26.805498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f95718-4ca3-4ccf-ae03-42b161299c31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:26.822619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f95718-4ca3-4ccf-ae03-42b161299c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-12f95718-4ca3-4ccf-ae03-42b161299c31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:26.830325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:26.831459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:26.832465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:26.835351 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 176/364] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:15:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:26.836355 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f95718-4ca3-4ccf-ae03-42b161299c31 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:26.847135 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc873f34-7c81-48f8-9bc0-ce42a2012793 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:26.884957 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:26.898329 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc830c3-6f76-465d-a462-c912ce817f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:26.900064 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc830c3-6f76-465d-a462-c912ce817f9a None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:26.900652 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc830c3-6f76-465d-a462-c912ce817f9a None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:26.901279 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc830c3-6f76-465d-a462-c912ce817f9a None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:26.903134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc830c3-6f76-465d-a462-c912ce817f9a None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:26.905162 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc830c3-6f76-465d-a462-c912ce817f9a None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:26.908174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 189/365] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:26 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:26.914553 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc830c3-6f76-465d-a462-c912ce817f9a None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:26.995803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f95718-4ca3-4ccf-ae03-42b161299c31 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:27.035870 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc830c3-6f76-465d-a462-c912ce817f9a None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:27.044638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc813f0-0063-4db0-9d61-547584b93632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:27.045579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc813f0-0063-4db0-9d61-547584b93632 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:27.046066 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc813f0-0063-4db0-9d61-547584b93632 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:27.047053 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc813f0-0063-4db0-9d61-547584b93632 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:27.049446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc813f0-0063-4db0-9d61-547584b93632 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:27.051812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc813f0-0063-4db0-9d61-547584b93632 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:27.054657 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 177/366] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:26 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:27.056534 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc813f0-0063-4db0-9d61-547584b93632 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:27.077281 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2a1f-5a50-4b6d-a5d0-8839cf3c4bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:27.077987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2a1f-5a50-4b6d-a5d0-8839cf3c4bec None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:27.078388 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2a1f-5a50-4b6d-a5d0-8839cf3c4bec None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:27.078685 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2a1f-5a50-4b6d-a5d0-8839cf3c4bec None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:27.079466 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2a1f-5a50-4b6d-a5d0-8839cf3c4bec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:27.079836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2a1f-5a50-4b6d-a5d0-8839cf3c4bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:27.081456 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2a1f-5a50-4b6d-a5d0-8839cf3c4bec None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:27.092350 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 190/367] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:27.093390 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2a1f-5a50-4b6d-a5d0-8839cf3c4bec None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:27.111770 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:27.178366 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:27.183240 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc813f0-0063-4db0-9d61-547584b93632 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:27.228080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8782c-6606-4d36-9ff3-5f9c810dffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:27.228682 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8782c-6606-4d36-9ff3-5f9c810dffb4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:27.228963 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8782c-6606-4d36-9ff3-5f9c810dffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:27.229235 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8782c-6606-4d36-9ff3-5f9c810dffb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:27.229978 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8782c-6606-4d36-9ff3-5f9c810dffb4 None admin] RBAC: Adding query filter params (group.id=c85c4d8261804b6aa09acd8350f37f27, role.id=75e4b5f3154e45059ce3a6449ac4ba3e, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:27.230257 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8782c-6606-4d36-9ff3-5f9c810dffb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:27.231849 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8782c-6606-4d36-9ff3-5f9c810dffb4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:27.237548 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 178/368] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 11 18:15:27 2022] GET /identity/v3/role_assignments?group.id=c85c4d8261804b6aa09acd8350f37f27&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=75e4b5f3154e45059ce3a6449ac4ba3e => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:27.238710 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8782c-6606-4d36-9ff3-5f9c810dffb4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:27.240828 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2a1f-5a50-4b6d-a5d0-8839cf3c4bec None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:27.280968 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97478e-346c-4dfb-99a0-266a1b8b67c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:27.281862 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97478e-346c-4dfb-99a0-266a1b8b67c8 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:27.282292 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97478e-346c-4dfb-99a0-266a1b8b67c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:27.282741 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97478e-346c-4dfb-99a0-266a1b8b67c8 None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:27.284102 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97478e-346c-4dfb-99a0-266a1b8b67c8 None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:27.285712 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97478e-346c-4dfb-99a0-266a1b8b67c8 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:27.287974 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 191/369] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:27 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:27.289065 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97478e-346c-4dfb-99a0-266a1b8b67c8 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:27.361516 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8782c-6606-4d36-9ff3-5f9c810dffb4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:27.381914 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:27.411162 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7801818-0de8-429d-9c89-1aad49bc907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:27.412156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7801818-0de8-429d-9c89-1aad49bc907f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:27.413030 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7801818-0de8-429d-9c89-1aad49bc907f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:27.413782 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7801818-0de8-429d-9c89-1aad49bc907f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:27.416022 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97478e-346c-4dfb-99a0-266a1b8b67c8 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:27.444879 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:27.460541 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed6b7-74dd-4bb3-a17d-4ad5ad64404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:27.461278 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed6b7-74dd-4bb3-a17d-4ad5ad64404c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:27.461457 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed6b7-74dd-4bb3-a17d-4ad5ad64404c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:27.461796 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed6b7-74dd-4bb3-a17d-4ad5ad64404c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:27.478257 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ed6b7-74dd-4bb3-a17d-4ad5ad64404c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-c46ed6b7-74dd-4bb3-a17d-4ad5ad64404c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:27.487693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:27.488805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:15:27.489752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:27.493639 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 192/370] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:27.495222 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed6b7-74dd-4bb3-a17d-4ad5ad64404c None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:27.514367 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7801818-0de8-429d-9c89-1aad49bc907f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:27.516290 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7801818-0de8-429d-9c89-1aad49bc907f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:27.631551 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed6b7-74dd-4bb3-a17d-4ad5ad64404c None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:27.637144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 179/371] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:27.638116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7801818-0de8-429d-9c89-1aad49bc907f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:27.648631 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:27.682397 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3da89-d9df-4ff5-9b3c-eea107bc1d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:27.683328 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3da89-d9df-4ff5-9b3c-eea107bc1d27 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:27.683779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3da89-d9df-4ff5-9b3c-eea107bc1d27 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:27.684227 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3da89-d9df-4ff5-9b3c-eea107bc1d27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:27.685143 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3da89-d9df-4ff5-9b3c-eea107bc1d27 None admin] RBAC: Adding query filter params (group.id=c85c4d8261804b6aa09acd8350f37f27, role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:27.686893 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3da89-d9df-4ff5-9b3c-eea107bc1d27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:27.688978 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3da89-d9df-4ff5-9b3c-eea107bc1d27 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:27.697039 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 193/372] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 11 18:15:27 2022] GET /identity/v3/role_assignments?group.id=c85c4d8261804b6aa09acd8350f37f27&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:27.698386 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3da89-d9df-4ff5-9b3c-eea107bc1d27 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:27.771934 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7801818-0de8-429d-9c89-1aad49bc907f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:27.774999 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:27.823707 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24a429-938b-4e6c-829b-2caa6d953e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:27.824352 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a429-938b-4e6c-829b-2caa6d953e7c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:27.824637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a429-938b-4e6c-829b-2caa6d953e7c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:27.824914 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a429-938b-4e6c-829b-2caa6d953e7c None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:27.825615 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24a429-938b-4e6c-829b-2caa6d953e7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:27.826034 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24a429-938b-4e6c-829b-2caa6d953e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:27.828792 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24a429-938b-4e6c-829b-2caa6d953e7c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:27.839993 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 180/373] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:27.856686 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3da89-d9df-4ff5-9b3c-eea107bc1d27 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:27.861088 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24a429-938b-4e6c-829b-2caa6d953e7c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:27.936106 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d7e91-7aac-408c-b152-f2497589f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:27.936671 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d7e91-7aac-408c-b152-f2497589f526 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:27.936956 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d7e91-7aac-408c-b152-f2497589f526 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:27.937232 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d7e91-7aac-408c-b152-f2497589f526 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:27.939871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d7e91-7aac-408c-b152-f2497589f526 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:27.941341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d7e91-7aac-408c-b152-f2497589f526 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:27.944537 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 194/374] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:27 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:27.949196 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d7e91-7aac-408c-b152-f2497589f526 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:27.988668 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:28.051337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24a429-938b-4e6c-829b-2caa6d953e7c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:28.078210 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d7e91-7aac-408c-b152-f2497589f526 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:28.096406 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:28.115407 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0faa4-f2cd-4d61-aed5-63cd16d4c336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:28.116456 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0faa4-f2cd-4d61-aed5-63cd16d4c336 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:28.116921 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0faa4-f2cd-4d61-aed5-63cd16d4c336 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:28.117373 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0faa4-f2cd-4d61-aed5-63cd16d4c336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:28.134934 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bd7cf-7fa7-4323-8c6a-08732624457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:28.135876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd7cf-7fa7-4323-8c6a-08732624457f None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:28.136361 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd7cf-7fa7-4323-8c6a-08732624457f None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:28.136823 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd7cf-7fa7-4323-8c6a-08732624457f None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:28.138501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bd7cf-7fa7-4323-8c6a-08732624457f None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:28.140381 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bd7cf-7fa7-4323-8c6a-08732624457f None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:28.145026 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 195/375] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:27 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:28.151452 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bd7cf-7fa7-4323-8c6a-08732624457f None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:28.245647 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0faa4-f2cd-4d61-aed5-63cd16d4c336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:28.247750 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0faa4-f2cd-4d61-aed5-63cd16d4c336 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:28.323294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:28.365626 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 181/376] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:28.367740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0faa4-f2cd-4d61-aed5-63cd16d4c336 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:28.387523 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bd7cf-7fa7-4323-8c6a-08732624457f None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:28.436017 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a70d28-fd5d-4612-9eee-0dca1103e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:28.436614 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a70d28-fd5d-4612-9eee-0dca1103e76c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:28.436892 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a70d28-fd5d-4612-9eee-0dca1103e76c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:28.437160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a70d28-fd5d-4612-9eee-0dca1103e76c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:28.438137 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a70d28-fd5d-4612-9eee-0dca1103e76c None admin] RBAC: Adding query filter params (group.id=c85c4d8261804b6aa09acd8350f37f27, role.id=75e4b5f3154e45059ce3a6449ac4ba3e, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:28.438246 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a70d28-fd5d-4612-9eee-0dca1103e76c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:28.439680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a70d28-fd5d-4612-9eee-0dca1103e76c None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:28.445646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 196/377] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 11 18:15:28 2022] GET /identity/v3/role_assignments?group.id=c85c4d8261804b6aa09acd8350f37f27&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=75e4b5f3154e45059ce3a6449ac4ba3e => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:28.447385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536084-092e-4cb8-adcd-e48aebf003be None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:28.447731 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536084-092e-4cb8-adcd-e48aebf003be None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:28.448011 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536084-092e-4cb8-adcd-e48aebf003be None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:28.449263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 197/378] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:28.455025 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009730-5dfe-4972-a37e-6bcad06930b3 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:28.455321 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009730-5dfe-4972-a37e-6bcad06930b3 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:28.455570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009730-5dfe-4972-a37e-6bcad06930b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:28.477257 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-8d009730-5dfe-4972-a37e-6bcad06930b3 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:28.478511 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-8d009730-5dfe-4972-a37e-6bcad06930b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:28.508100 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0faa4-f2cd-4d61-aed5-63cd16d4c336 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:28.537852 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:28.550505 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e727abc-0973-45e0-9244-f375b1b7499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:28.551217 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e727abc-0973-45e0-9244-f375b1b7499e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:28.551495 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e727abc-0973-45e0-9244-f375b1b7499e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:28.551763 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e727abc-0973-45e0-9244-f375b1b7499e None admin] PATH_INFO: `/v3/projects/83c912d6fcae45219e4abbd9eb74f129` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:28.552993 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e727abc-0973-45e0-9244-f375b1b7499e None admin] RBAC: Authorizing `identity:get_project(project_id=83c912d6fcae45219e4abbd9eb74f129)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:28.556337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e727abc-0973-45e0-9244-f375b1b7499e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:28.558690 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 182/379] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:28 2022] GET /identity/v3/projects/83c912d6fcae45219e4abbd9eb74f129 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:28.565152 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e727abc-0973-45e0-9244-f375b1b7499e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:28.577067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 198/380] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:28.612490 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:28.690215 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e727abc-0973-45e0-9244-f375b1b7499e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:28.737935 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2473b1-e7f8-4f89-8b93-668431a59058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:28.738626 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2473b1-e7f8-4f89-8b93-668431a59058 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:28.738931 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2473b1-e7f8-4f89-8b93-668431a59058 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:28.739207 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2473b1-e7f8-4f89-8b93-668431a59058 None admin] PATH_INFO: `/v3/groups/a391f1c0739e44ee968beabd7b84a302` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:28.751069 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2473b1-e7f8-4f89-8b93-668431a59058 None admin] RBAC: Authorizing `identity:get_group(group_id=a391f1c0739e44ee968beabd7b84a302)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:28.752574 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2473b1-e7f8-4f89-8b93-668431a59058 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:28.754503 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 183/381] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:28 2022] GET /identity/v3/groups/a391f1c0739e44ee968beabd7b84a302 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:28.760814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009730-5dfe-4972-a37e-6bcad06930b3 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:28.880032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009730-5dfe-4972-a37e-6bcad06930b3 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:28.925197 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea657ae-248a-49cb-8dd5-c664daa53492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:28.925802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea657ae-248a-49cb-8dd5-c664daa53492 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:28.926086 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea657ae-248a-49cb-8dd5-c664daa53492 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:28.926360 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea657ae-248a-49cb-8dd5-c664daa53492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:28.927177 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea657ae-248a-49cb-8dd5-c664daa53492 None admin] RBAC: Adding query filter params (group.id=a391f1c0739e44ee968beabd7b84a302, role.id=f89efd1f713043d8835c127de30f53ca, scope.project.id=83c912d6fcae45219e4abbd9eb74f129) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:28.927487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea657ae-248a-49cb-8dd5-c664daa53492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:28.928998 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea657ae-248a-49cb-8dd5-c664daa53492 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:28.937978 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 199/382] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 11 18:15:28 2022] GET /identity/v3/role_assignments?group.id=a391f1c0739e44ee968beabd7b84a302&scope.project.id=83c912d6fcae45219e4abbd9eb74f129&role.id=f89efd1f713043d8835c127de30f53ca => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:28.993230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2473b1-e7f8-4f89-8b93-668431a59058 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:29.127862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:29.132142 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2473b1-e7f8-4f89-8b93-668431a59058 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:29.191179 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebb5bf-8564-4b54-8b7e-ea7ed2b62467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:29.192240 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebb5bf-8564-4b54-8b7e-ea7ed2b62467 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:29.192720 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebb5bf-8564-4b54-8b7e-ea7ed2b62467 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:29.193258 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebb5bf-8564-4b54-8b7e-ea7ed2b62467 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:29.210576 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebb5bf-8564-4b54-8b7e-ea7ed2b62467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-65ebb5bf-8564-4b54-8b7e-ea7ed2b62467 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:29.216766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:29.217716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:29.218498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:29.220737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 184/383] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:29.226922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea657ae-248a-49cb-8dd5-c664daa53492 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:29.300736 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:29.371427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea657ae-248a-49cb-8dd5-c664daa53492 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:29.418392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e5b41-0c20-44f3-ba29-13d2b1af4267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:29.419026 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e5b41-0c20-44f3-ba29-13d2b1af4267 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:29.419216 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e5b41-0c20-44f3-ba29-13d2b1af4267 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:29.419493 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e5b41-0c20-44f3-ba29-13d2b1af4267 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:29.420162 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e5b41-0c20-44f3-ba29-13d2b1af4267 None admin] RBAC: Adding query filter params (name=member) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:29.420468 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e5b41-0c20-44f3-ba29-13d2b1af4267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:29.421843 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e5b41-0c20-44f3-ba29-13d2b1af4267 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:29.436136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 200/384] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:29.441797 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebb5bf-8564-4b54-8b7e-ea7ed2b62467 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:29.591934 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebb5bf-8564-4b54-8b7e-ea7ed2b62467 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:29.638269 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5420001-d044-407a-bc13-4a92dd69cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:29.638986 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5420001-d044-407a-bc13-4a92dd69cf5e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:29.639274 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5420001-d044-407a-bc13-4a92dd69cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:29.639553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5420001-d044-407a-bc13-4a92dd69cf5e None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:29.640689 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5420001-d044-407a-bc13-4a92dd69cf5e None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:29.642132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5420001-d044-407a-bc13-4a92dd69cf5e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:29.644096 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 185/385] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:29 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:29.655790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e5b41-0c20-44f3-ba29-13d2b1af4267 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:29.817856 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e5b41-0c20-44f3-ba29-13d2b1af4267 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:29.821402 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:29.891574 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f6fe2-0903-44ea-8912-c3a7a548febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:29.892219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6fe2-0903-44ea-8912-c3a7a548febf None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:29.892499 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6fe2-0903-44ea-8912-c3a7a548febf None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:29.892777 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6fe2-0903-44ea-8912-c3a7a548febf None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:29.893937 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f6fe2-0903-44ea-8912-c3a7a548febf None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:29.895402 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f6fe2-0903-44ea-8912-c3a7a548febf None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:29.897350 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 201/386] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:29 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:29.903894 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5420001-d044-407a-bc13-4a92dd69cf5e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:29.959324 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:30.044581 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5420001-d044-407a-bc13-4a92dd69cf5e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:30.065867 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd2713-ed46-4da1-ab9f-ad5c9661d24e None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:30.066190 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd2713-ed46-4da1-ab9f-ad5c9661d24e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:30.066425 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd2713-ed46-4da1-ab9f-ad5c9661d24e None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:30.068114 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 202/387] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:30.073882 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1af72-97f8-4d73-b50b-e2c08a5f02b1 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:30.074193 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1af72-97f8-4d73-b50b-e2c08a5f02b1 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:30.074433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1af72-97f8-4d73-b50b-e2c08a5f02b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:30.085744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e53c-df63-4760-8cde-c8b3fe8c8753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:30.086470 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e53c-df63-4760-8cde-c8b3fe8c8753 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:30.087374 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e53c-df63-4760-8cde-c8b3fe8c8753 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:30.087653 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e53c-df63-4760-8cde-c8b3fe8c8753 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/groups/c85c4d8261804b6aa09acd8350f37f27/roles/1e94f00bf0f044b89bc9bd8dab18e2fa` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:30.091452 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603e53c-df63-4760-8cde-c8b3fe8c8753 None admin] RBAC: Authorizing `identity:create_grant(project_id=acffc2592e8c40299db4c5bf775f0ca2, group_id=c85c4d8261804b6aa09acd8350f37f27, role_id=1e94f00bf0f044b89bc9bd8dab18e2fa)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:30.092905 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603e53c-df63-4760-8cde-c8b3fe8c8753 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:30.095837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-2ba1af72-97f8-4d73-b50b-e2c08a5f02b1 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:30.097034 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-2ba1af72-97f8-4d73-b50b-e2c08a5f02b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:30.173440 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 186/388] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Aug 11 18:15:29 2022] PUT /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/groups/c85c4d8261804b6aa09acd8350f37f27/roles/1e94f00bf0f044b89bc9bd8dab18e2fa => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:30.179124 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 203/389] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:30.543643 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e53c-df63-4760-8cde-c8b3fe8c8753 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:30.647198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:30.660159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e53c-df63-4760-8cde-c8b3fe8c8753 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:30.702015 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180032a-e5c8-433c-9529-1b08c71d7ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:30.702658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180032a-e5c8-433c-9529-1b08c71d7ea9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:30.702963 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180032a-e5c8-433c-9529-1b08c71d7ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:30.703256 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180032a-e5c8-433c-9529-1b08c71d7ea9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:30.717140 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180032a-e5c8-433c-9529-1b08c71d7ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-6180032a-e5c8-433c-9529-1b08c71d7ea9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:30.722068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:30.723005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:30.723801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 187/390] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:15:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:30.729510 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1af72-97f8-4d73-b50b-e2c08a5f02b1 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:30.855907 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:30.859322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1af72-97f8-4d73-b50b-e2c08a5f02b1 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:30.902651 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752d64e-47f6-4f07-b4a3-9bf0846e7755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:30.903336 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752d64e-47f6-4f07-b4a3-9bf0846e7755 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:30.903888 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752d64e-47f6-4f07-b4a3-9bf0846e7755 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:30.904476 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752d64e-47f6-4f07-b4a3-9bf0846e7755 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:30.905224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752d64e-47f6-4f07-b4a3-9bf0846e7755 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:30.905535 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752d64e-47f6-4f07-b4a3-9bf0846e7755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:30.907148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752d64e-47f6-4f07-b4a3-9bf0846e7755 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:30.917441 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 204/391] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:30.923281 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180032a-e5c8-433c-9529-1b08c71d7ea9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:31.040382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180032a-e5c8-433c-9529-1b08c71d7ea9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:31.079948 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a238d-1f32-4880-b55d-dcf17bab2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:31.080596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a238d-1f32-4880-b55d-dcf17bab2dad None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:31.080879 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a238d-1f32-4880-b55d-dcf17bab2dad None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:31.081157 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a238d-1f32-4880-b55d-dcf17bab2dad None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:31.082416 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a238d-1f32-4880-b55d-dcf17bab2dad None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:31.083898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a238d-1f32-4880-b55d-dcf17bab2dad None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:31.085839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 188/392] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:30 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:31.091269 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752d64e-47f6-4f07-b4a3-9bf0846e7755 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:31.190074 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ce042-549b-46fe-acf4-865df3390d49 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:31.190369 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ce042-549b-46fe-acf4-865df3390d49 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:31.190558 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ce042-549b-46fe-acf4-865df3390d49 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:31.191941 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 189/393] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:31.198065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a9c55-62d0-411b-b789-3de3efa22bbe None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:31.198354 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a9c55-62d0-411b-b789-3de3efa22bbe None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:31.198696 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a9c55-62d0-411b-b789-3de3efa22bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:31.221209 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-560a9c55-62d0-411b-b789-3de3efa22bbe None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:31.222694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-560a9c55-62d0-411b-b789-3de3efa22bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:31.239223 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:31.270733 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752d64e-47f6-4f07-b4a3-9bf0846e7755 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:31.307812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 190/394] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:31.345754 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c99dd-4923-4df6-8c94-56ce5d680eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:31.346392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c99dd-4923-4df6-8c94-56ce5d680eb0 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:31.346689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c99dd-4923-4df6-8c94-56ce5d680eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:31.346972 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c99dd-4923-4df6-8c94-56ce5d680eb0 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:31.348137 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c99dd-4923-4df6-8c94-56ce5d680eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:31.349570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c99dd-4923-4df6-8c94-56ce5d680eb0 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:31.351607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 205/395] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:31 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:31.357403 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a9c55-62d0-411b-b789-3de3efa22bbe None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:31.477091 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a9c55-62d0-411b-b789-3de3efa22bbe None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:31.520868 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddc42e-9638-4a81-a1df-3fcfb9b937c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:31.521549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddc42e-9638-4a81-a1df-3fcfb9b937c1 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:31.521830 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddc42e-9638-4a81-a1df-3fcfb9b937c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:31.522105 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddc42e-9638-4a81-a1df-3fcfb9b937c1 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/groups/c85c4d8261804b6aa09acd8350f37f27/roles/75e4b5f3154e45059ce3a6449ac4ba3e` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:31.525628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddc42e-9638-4a81-a1df-3fcfb9b937c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=acffc2592e8c40299db4c5bf775f0ca2, group_id=c85c4d8261804b6aa09acd8350f37f27, role_id=75e4b5f3154e45059ce3a6449ac4ba3e)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:31.527138 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddc42e-9638-4a81-a1df-3fcfb9b937c1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:31.637956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 191/396] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Aug 11 18:15:31 2022] PUT /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2/groups/c85c4d8261804b6aa09acd8350f37f27/roles/75e4b5f3154e45059ce3a6449ac4ba3e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:31.681763 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df805a2-8384-4a89-a887-662512baae63 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:31.682088 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df805a2-8384-4a89-a887-662512baae63 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:31.682317 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df805a2-8384-4a89-a887-662512baae63 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:31.683984 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 206/397] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:31.695827 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564f4dd-1708-472c-a0c6-54619409dc53 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:31.696814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564f4dd-1708-472c-a0c6-54619409dc53 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:31.697103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564f4dd-1708-472c-a0c6-54619409dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:31.714060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:31.722129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1564f4dd-1708-472c-a0c6-54619409dc53 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:31.723416 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1564f4dd-1708-472c-a0c6-54619409dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:31.787561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df805a2-8384-4a89-a887-662512baae63 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:31.826982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 192/398] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:31.845087 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:31.937461 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df805a2-8384-4a89-a887-662512baae63 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:31.977840 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae22a2e-c0f7-4efa-ab28-c9cb8870bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:31.978476 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22a2e-c0f7-4efa-ab28-c9cb8870bd6d None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:31.978782 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22a2e-c0f7-4efa-ab28-c9cb8870bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:31.979059 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22a2e-c0f7-4efa-ab28-c9cb8870bd6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:31.989710 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae22a2e-c0f7-4efa-ab28-c9cb8870bd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-eae22a2e-c0f7-4efa-ab28-c9cb8870bd6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:31.995113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:31.996014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:31.996804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:32.000352 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 207/399] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:32.002779 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564f4dd-1708-472c-a0c6-54619409dc53 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:32.110209 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564f4dd-1708-472c-a0c6-54619409dc53 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:32.133576 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11376fe5-6a87-48a7-b05a-409f2169291b None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:32.134016 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11376fe5-6a87-48a7-b05a-409f2169291b None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:32.134310 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11376fe5-6a87-48a7-b05a-409f2169291b None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:32.135930 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 208/400] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:15:32.140745 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3d1bc-90ab-40af-b247-a8c73500dcb2 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:32.141027 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3d1bc-90ab-40af-b247-a8c73500dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:32.141301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3d1bc-90ab-40af-b247-a8c73500dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:32.150701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc87680-b85b-48c0-ba12-cd65d4e9350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:32.151325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc87680-b85b-48c0-ba12-cd65d4e9350a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:32.151601 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc87680-b85b-48c0-ba12-cd65d4e9350a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:32.151872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc87680-b85b-48c0-ba12-cd65d4e9350a None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:32.152540 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc87680-b85b-48c0-ba12-cd65d4e9350a None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:32.152840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc87680-b85b-48c0-ba12-cd65d4e9350a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:32.154215 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc87680-b85b-48c0-ba12-cd65d4e9350a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:32.156776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:32.164566 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 193/401] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:32.170211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc87680-b85b-48c0-ba12-cd65d4e9350a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:32.173383 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-19e3d1bc-90ab-40af-b247-a8c73500dcb2 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:32.174583 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-19e3d1bc-90ab-40af-b247-a8c73500dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:32.278182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 209/402] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:32.279003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3d1bc-90ab-40af-b247-a8c73500dcb2 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:32.286632 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc87680-b85b-48c0-ba12-cd65d4e9350a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:32.303868 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:32.374477 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d543fd-23c2-4506-9471-e6e7e8a56cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:32.375155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d543fd-23c2-4506-9471-e6e7e8a56cfb None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:32.375431 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d543fd-23c2-4506-9471-e6e7e8a56cfb None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:32.375702 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d543fd-23c2-4506-9471-e6e7e8a56cfb None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:32.379504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d543fd-23c2-4506-9471-e6e7e8a56cfb None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:32.380929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d543fd-23c2-4506-9471-e6e7e8a56cfb None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:32.382493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 194/403] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:32 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:32.388134 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d543fd-23c2-4506-9471-e6e7e8a56cfb None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:32.419426 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3d1bc-90ab-40af-b247-a8c73500dcb2 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:32.480753 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ef68a-7107-4fe6-bec7-7707b41fc06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:32.481385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ef68a-7107-4fe6-bec7-7707b41fc06d None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:32.481663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ef68a-7107-4fe6-bec7-7707b41fc06d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:32.481988 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ef68a-7107-4fe6-bec7-7707b41fc06d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:32.496255 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ef68a-7107-4fe6-bec7-7707b41fc06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-307ef68a-7107-4fe6-bec7-7707b41fc06d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:32.502252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:32.503304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:32.504288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 210/404] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:15:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:32.509436 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:32.512622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ef68a-7107-4fe6-bec7-7707b41fc06d None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:32.580093 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d543fd-23c2-4506-9471-e6e7e8a56cfb None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:32.636219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980cab1-a5c9-46d8-a893-cec30ef844b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:32.637195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980cab1-a5c9-46d8-a893-cec30ef844b2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:32.637693 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980cab1-a5c9-46d8-a893-cec30ef844b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:32.638335 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980cab1-a5c9-46d8-a893-cec30ef844b2 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:32.641818 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980cab1-a5c9-46d8-a893-cec30ef844b2 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:32.643485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980cab1-a5c9-46d8-a893-cec30ef844b2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:32.645861 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 195/405] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:32 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:32.655546 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980cab1-a5c9-46d8-a893-cec30ef844b2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:32.672036 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:32.692905 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ef68a-7107-4fe6-bec7-7707b41fc06d None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:32.729703 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d788c2-aa23-4a81-a5eb-f0b406b628a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:32.735713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d788c2-aa23-4a81-a5eb-f0b406b628a3 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:32.736381 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d788c2-aa23-4a81-a5eb-f0b406b628a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:32.736950 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d788c2-aa23-4a81-a5eb-f0b406b628a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:32.737835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d788c2-aa23-4a81-a5eb-f0b406b628a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:32.738827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d788c2-aa23-4a81-a5eb-f0b406b628a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:32.740431 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d788c2-aa23-4a81-a5eb-f0b406b628a3 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:32.752629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 211/406] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:32.753931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d788c2-aa23-4a81-a5eb-f0b406b628a3 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:32.808663 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980cab1-a5c9-46d8-a893-cec30ef844b2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:32.845238 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9494a4-8340-4713-b37b-c7b40aa44edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:32.845816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9494a4-8340-4713-b37b-c7b40aa44edd None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:32.846095 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9494a4-8340-4713-b37b-c7b40aa44edd None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:32.846402 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9494a4-8340-4713-b37b-c7b40aa44edd None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/groups/c85c4d8261804b6aa09acd8350f37f27/roles/1e94f00bf0f044b89bc9bd8dab18e2fa` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:32.848364 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9494a4-8340-4713-b37b-c7b40aa44edd None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5c02b35e89464a8e8356e42fbf5165, group_id=c85c4d8261804b6aa09acd8350f37f27, role_id=1e94f00bf0f044b89bc9bd8dab18e2fa)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:32.849794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9494a4-8340-4713-b37b-c7b40aa44edd None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:32.852207 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:32.863863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d788c2-aa23-4a81-a5eb-f0b406b628a3 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:32.901621 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdfa6a-991a-4a3c-808e-5eed21030b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:32.902246 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdfa6a-991a-4a3c-808e-5eed21030b51 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:32.902527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdfa6a-991a-4a3c-808e-5eed21030b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:32.902824 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdfa6a-991a-4a3c-808e-5eed21030b51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:32.912971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdfa6a-991a-4a3c-808e-5eed21030b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:32.926735 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 196/407] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Aug 11 18:15:32 2022] PUT /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/groups/c85c4d8261804b6aa09acd8350f37f27/roles/1e94f00bf0f044b89bc9bd8dab18e2fa => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:32.926735 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9494a4-8340-4713-b37b-c7b40aa44edd None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-9ecdfa6a-991a-4a3c-808e-5eed21030b51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:32.927563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:32.928481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:15:32.929319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:32.932598 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 212/408] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:15:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:32.935148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bac4a-4ca8-4f6d-b860-f938c5e03112 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:32.935435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bac4a-4ca8-4f6d-b860-f938c5e03112 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:32.935706 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bac4a-4ca8-4f6d-b860-f938c5e03112 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:32.938773 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 213/409] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:32.938773 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bac4a-4ca8-4f6d-b860-f938c5e03112 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:32.946596 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:33.072371 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bac4a-4ca8-4f6d-b860-f938c5e03112 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:33.099899 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9494a4-8340-4713-b37b-c7b40aa44edd None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:33.115278 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ff828-37ce-46c0-affe-62689695fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:33.116307 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ff828-37ce-46c0-affe-62689695fb97 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:33.116600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ff828-37ce-46c0-affe-62689695fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:33.118223 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ff828-37ce-46c0-affe-62689695fb97 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:33.119064 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ff828-37ce-46c0-affe-62689695fb97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:33.119471 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ff828-37ce-46c0-affe-62689695fb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:33.121421 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ff828-37ce-46c0-affe-62689695fb97 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:33.131377 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 214/410] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:33.132595 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e3048-eaf7-4e60-aec1-f26a45e60043 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:33.133236 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e3048-eaf7-4e60-aec1-f26a45e60043 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:33.133236 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e3048-eaf7-4e60-aec1-f26a45e60043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:33.151097 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d56c1-518d-4c60-b955-5634db4ef9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:33.152115 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d56c1-518d-4c60-b955-5634db4ef9fb None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:33.152656 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d56c1-518d-4c60-b955-5634db4ef9fb None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:33.153282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d56c1-518d-4c60-b955-5634db4ef9fb None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:33.154735 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d56c1-518d-4c60-b955-5634db4ef9fb None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:33.156553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d56c1-518d-4c60-b955-5634db4ef9fb None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:33.158305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-be9e3048-eaf7-4e60-aec1-f26a45e60043 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:33.159031 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 197/411] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:32 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:33.159591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-be9e3048-eaf7-4e60-aec1-f26a45e60043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:33.160227 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d56c1-518d-4c60-b955-5634db4ef9fb None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:33.225221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:33.233844 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 215/412] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:33.238757 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e3048-eaf7-4e60-aec1-f26a45e60043 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:33.241367 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:33.305678 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d56c1-518d-4c60-b955-5634db4ef9fb None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:33.371025 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d5ae-7692-4e06-89d0-b311aca24032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:33.371569 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d5ae-7692-4e06-89d0-b311aca24032 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:33.371849 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d5ae-7692-4e06-89d0-b311aca24032 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:33.372122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d5ae-7692-4e06-89d0-b311aca24032 None admin] PATH_INFO: `/v3/groups/a391f1c0739e44ee968beabd7b84a302` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:33.373576 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833d5ae-7692-4e06-89d0-b311aca24032 None admin] RBAC: Authorizing `identity:get_group(group_id=a391f1c0739e44ee968beabd7b84a302)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:33.375040 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833d5ae-7692-4e06-89d0-b311aca24032 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:33.378908 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 198/413] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:33 2022] GET /identity/v3/groups/a391f1c0739e44ee968beabd7b84a302 => generated 229 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:33.381892 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d5ae-7692-4e06-89d0-b311aca24032 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:33.396458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e3048-eaf7-4e60-aec1-f26a45e60043 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:33.470056 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9791-009b-42b8-a8d2-0cf61a78ee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:33.470767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9791-009b-42b8-a8d2-0cf61a78ee30 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:33.470983 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9791-009b-42b8-a8d2-0cf61a78ee30 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:33.471254 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9791-009b-42b8-a8d2-0cf61a78ee30 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:33.475450 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba9791-009b-42b8-a8d2-0cf61a78ee30 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:33.478029 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba9791-009b-42b8-a8d2-0cf61a78ee30 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:33.479971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 216/414] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:33 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:33.485837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9791-009b-42b8-a8d2-0cf61a78ee30 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:33.519732 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d5ae-7692-4e06-89d0-b311aca24032 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:33.557704 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b60339-f558-4843-98b6-1022f73a45d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:33.558814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b60339-f558-4843-98b6-1022f73a45d0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:33.559316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b60339-f558-4843-98b6-1022f73a45d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:33.559849 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b60339-f558-4843-98b6-1022f73a45d0 None admin] PATH_INFO: `/v3/projects/83c912d6fcae45219e4abbd9eb74f129` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:33.561302 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b60339-f558-4843-98b6-1022f73a45d0 None admin] RBAC: Authorizing `identity:get_project(project_id=83c912d6fcae45219e4abbd9eb74f129)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:33.563039 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b60339-f558-4843-98b6-1022f73a45d0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:33.565232 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:33.565679 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 199/415] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:33 2022] GET /identity/v3/projects/83c912d6fcae45219e4abbd9eb74f129 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:33.572121 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b60339-f558-4843-98b6-1022f73a45d0 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:33.652054 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:33.692346 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9791-009b-42b8-a8d2-0cf61a78ee30 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:33.697403 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b60339-f558-4843-98b6-1022f73a45d0 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:33.730844 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba84ae-6b05-48b3-b515-1875e6a5136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:33.731444 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba84ae-6b05-48b3-b515-1875e6a5136a None admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:33.732073 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba84ae-6b05-48b3-b515-1875e6a5136a None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:33.732073 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba84ae-6b05-48b3-b515-1875e6a5136a None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/groups/c85c4d8261804b6aa09acd8350f37f27/roles/75e4b5f3154e45059ce3a6449ac4ba3e` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:33.734452 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba84ae-6b05-48b3-b515-1875e6a5136a None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5c02b35e89464a8e8356e42fbf5165, group_id=c85c4d8261804b6aa09acd8350f37f27, role_id=75e4b5f3154e45059ce3a6449ac4ba3e)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:33.736117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba84ae-6b05-48b3-b515-1875e6a5136a None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:33.749316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae32a3-b106-47af-b5b8-182b7b342ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:33.750011 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae32a3-b106-47af-b5b8-182b7b342ace None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:33.750396 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae32a3-b106-47af-b5b8-182b7b342ace None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:33.750698 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae32a3-b106-47af-b5b8-182b7b342ace None admin] PATH_INFO: `/v3/projects/83c912d6fcae45219e4abbd9eb74f129/groups/a391f1c0739e44ee968beabd7b84a302/roles/f89efd1f713043d8835c127de30f53ca` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:33.752669 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae32a3-b106-47af-b5b8-182b7b342ace None admin] RBAC: Authorizing `identity:create_grant(project_id=83c912d6fcae45219e4abbd9eb74f129, group_id=a391f1c0739e44ee968beabd7b84a302, role_id=f89efd1f713043d8835c127de30f53ca)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:33.754123 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae32a3-b106-47af-b5b8-182b7b342ace None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:33.826871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 217/416] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Aug 11 18:15:33 2022] PUT /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165/groups/c85c4d8261804b6aa09acd8350f37f27/roles/75e4b5f3154e45059ce3a6449ac4ba3e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:33.828226 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba84ae-6b05-48b3-b515-1875e6a5136a None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:33.857056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 200/417] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Aug 11 18:15:33 2022] PUT /identity/v3/projects/83c912d6fcae45219e4abbd9eb74f129/groups/a391f1c0739e44ee968beabd7b84a302/roles/f89efd1f713043d8835c127de30f53ca => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:33.955101 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba84ae-6b05-48b3-b515-1875e6a5136a None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:33.983456 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:33.998158 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a0f3-3b20-45dc-83cc-938aa27e0ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:33.999225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a0f3-3b20-45dc-83cc-938aa27e0ed1 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:33.999563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a0f3-3b20-45dc-83cc-938aa27e0ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:33.999897 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a0f3-3b20-45dc-83cc-938aa27e0ed1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:34.013283 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a0f3-3b20-45dc-83cc-938aa27e0ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-38f8a0f3-3b20-45dc-83cc-938aa27e0ed1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:34.018433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:34.019612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:34.020593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:34.026872 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 218/418] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:34.031960 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae32a3-b106-47af-b5b8-182b7b342ace None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:34.136681 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:34.182534 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae32a3-b106-47af-b5b8-182b7b342ace None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:34.218989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cf9ea-6af9-4c66-b5ff-fa66164feffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:34.219521 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cf9ea-6af9-4c66-b5ff-fa66164feffa None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:34.219801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cf9ea-6af9-4c66-b5ff-fa66164feffa None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:34.220070 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cf9ea-6af9-4c66-b5ff-fa66164feffa None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:34.220728 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cf9ea-6af9-4c66-b5ff-fa66164feffa None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:34.221026 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cf9ea-6af9-4c66-b5ff-fa66164feffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:34.222491 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cf9ea-6af9-4c66-b5ff-fa66164feffa None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:34.233455 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 201/419] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:34.239471 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a0f3-3b20-45dc-83cc-938aa27e0ed1 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:34.352725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a0f3-3b20-45dc-83cc-938aa27e0ed1 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:34.389529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a115955-fc10-43ed-a150-029dc875680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:34.390371 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a115955-fc10-43ed-a150-029dc875680d None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:34.390827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a115955-fc10-43ed-a150-029dc875680d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:34.391242 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a115955-fc10-43ed-a150-029dc875680d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:34.439904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b129d-f0e3-4a89-9842-e1ce250f05b8 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:34.440330 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b129d-f0e3-4a89-9842-e1ce250f05b8 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:34.440705 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b129d-f0e3-4a89-9842-e1ce250f05b8 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:34.442373 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 202/420] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:34.443913 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:34.448132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747be3-e3cf-4815-bb24-6b03ed8f2586 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:34.448521 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747be3-e3cf-4815-bb24-6b03ed8f2586 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:34.449177 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747be3-e3cf-4815-bb24-6b03ed8f2586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:34.465917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a115955-fc10-43ed-a150-029dc875680d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:34.467680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a115955-fc10-43ed-a150-029dc875680d None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:34.486722 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-40747be3-e3cf-4815-bb24-6b03ed8f2586 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:34.488063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-40747be3-e3cf-4815-bb24-6b03ed8f2586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:34.581790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 219/421] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:34.583692 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a115955-fc10-43ed-a150-029dc875680d None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:34.675507 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:34.697819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a115955-fc10-43ed-a150-029dc875680d None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:34.713857 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 203/422] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:34.735412 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f529-763e-4582-966e-6f49e9c0028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:34.736336 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f529-763e-4582-966e-6f49e9c0028c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:34.736852 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f529-763e-4582-966e-6f49e9c0028c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:34.737302 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321f529-763e-4582-966e-6f49e9c0028c None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:34.739198 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321f529-763e-4582-966e-6f49e9c0028c None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:34.740874 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321f529-763e-4582-966e-6f49e9c0028c None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:34.750207 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 220/423] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:34 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:34.755775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747be3-e3cf-4815-bb24-6b03ed8f2586 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:34.827036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:34.862219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747be3-e3cf-4815-bb24-6b03ed8f2586 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:34.899619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818164b-4600-40d1-a862-643365cef0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:34.900404 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818164b-4600-40d1-a862-643365cef0e9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:34.900681 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818164b-4600-40d1-a862-643365cef0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:34.900950 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818164b-4600-40d1-a862-643365cef0e9 None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:34.902102 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818164b-4600-40d1-a862-643365cef0e9 None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:34.903630 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818164b-4600-40d1-a862-643365cef0e9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:34.910261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 204/424] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:34 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:34.911629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f529-763e-4582-966e-6f49e9c0028c None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:35.020825 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321f529-763e-4582-966e-6f49e9c0028c None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:35.057748 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7780933-8ad7-4ba1-9055-4d31499163e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:35.058409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780933-8ad7-4ba1-9055-4d31499163e2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:35.058715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780933-8ad7-4ba1-9055-4d31499163e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:35.058995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780933-8ad7-4ba1-9055-4d31499163e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:35.059747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7780933-8ad7-4ba1-9055-4d31499163e2 None admin] RBAC: Adding query filter params (group.id=c85c4d8261804b6aa09acd8350f37f27, role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:35.060155 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7780933-8ad7-4ba1-9055-4d31499163e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:35.061600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7780933-8ad7-4ba1-9055-4d31499163e2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:35.071298 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 221/425] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 11 18:15:34 2022] GET /identity/v3/role_assignments?group.id=c85c4d8261804b6aa09acd8350f37f27&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:35.153425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818164b-4600-40d1-a862-643365cef0e9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:35.305970 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818164b-4600-40d1-a862-643365cef0e9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:35.324142 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:35.342348 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78385a-9a60-4ea0-88a9-7b7469408c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:35.343049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78385a-9a60-4ea0-88a9-7b7469408c8f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:35.343330 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78385a-9a60-4ea0-88a9-7b7469408c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:35.343606 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78385a-9a60-4ea0-88a9-7b7469408c8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:35.359179 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78385a-9a60-4ea0-88a9-7b7469408c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-3f78385a-9a60-4ea0-88a9-7b7469408c8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:35.364359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:35.365549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:35.366425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 205/426] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:15:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:35.371993 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7780933-8ad7-4ba1-9055-4d31499163e2 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:35.393197 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:35.497920 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7780933-8ad7-4ba1-9055-4d31499163e2 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:35.537559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45236fb3-37c6-4d77-b638-8b71444f788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:35.538172 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45236fb3-37c6-4d77-b638-8b71444f788a None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:35.538454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45236fb3-37c6-4d77-b638-8b71444f788a None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:35.538757 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45236fb3-37c6-4d77-b638-8b71444f788a None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:35.540067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45236fb3-37c6-4d77-b638-8b71444f788a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:35.540373 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45236fb3-37c6-4d77-b638-8b71444f788a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:35.541753 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45236fb3-37c6-4d77-b638-8b71444f788a None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:35.552668 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 222/427] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:35.559128 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78385a-9a60-4ea0-88a9-7b7469408c8f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:35.569521 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66990d-15ba-4217-878f-0ecfd5504459 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:35.569803 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66990d-15ba-4217-878f-0ecfd5504459 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:35.570089 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66990d-15ba-4217-878f-0ecfd5504459 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:35.572352 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 223/428] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:35.577569 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a76d-7067-49ee-a848-84a6880c6366 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:35.577854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a76d-7067-49ee-a848-84a6880c6366 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:35.578156 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a76d-7067-49ee-a848-84a6880c6366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:35.597791 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-ead8a76d-7067-49ee-a848-84a6880c6366 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:35.599017 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-ead8a76d-7067-49ee-a848-84a6880c6366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:35.674799 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 224/429] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:35.682074 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78385a-9a60-4ea0-88a9-7b7469408c8f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:35.725497 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64f325-301e-4ed4-861a-b3cd94105445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:35.726301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64f325-301e-4ed4-861a-b3cd94105445 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:35.726616 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64f325-301e-4ed4-861a-b3cd94105445 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:35.726910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64f325-301e-4ed4-861a-b3cd94105445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:35.786582 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:35.809962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64f325-301e-4ed4-861a-b3cd94105445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:35.811417 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64f325-301e-4ed4-861a-b3cd94105445 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:35.917492 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 206/430] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:35.925515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8a76d-7067-49ee-a848-84a6880c6366 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:35.940487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:36.055803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64f325-301e-4ed4-861a-b3cd94105445 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:36.062140 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8a76d-7067-49ee-a848-84a6880c6366 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:36.105366 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675b533-d35f-478b-8d94-e02aecacfb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:36.106022 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675b533-d35f-478b-8d94-e02aecacfb38 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.106303 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675b533-d35f-478b-8d94-e02aecacfb38 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.106579 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675b533-d35f-478b-8d94-e02aecacfb38 None admin] PATH_INFO: `/v3/projects/acffc2592e8c40299db4c5bf775f0ca2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.107755 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675b533-d35f-478b-8d94-e02aecacfb38 None admin] RBAC: Authorizing `identity:get_project(project_id=acffc2592e8c40299db4c5bf775f0ca2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:36.109273 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675b533-d35f-478b-8d94-e02aecacfb38 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:36.111021 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 225/431] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:35 2022] GET /identity/v3/projects/acffc2592e8c40299db4c5bf775f0ca2 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:36.118874 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675b533-d35f-478b-8d94-e02aecacfb38 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:36.151356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:36.174387 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64f325-301e-4ed4-861a-b3cd94105445 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:36.201249 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:36.214083 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c263-f492-42a6-a862-d3ffd7f75ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:36.214750 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c263-f492-42a6-a862-d3ffd7f75ac4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.215045 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c263-f492-42a6-a862-d3ffd7f75ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.215327 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44c263-f492-42a6-a862-d3ffd7f75ac4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.225972 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44c263-f492-42a6-a862-d3ffd7f75ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:36.227564 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675b533-d35f-478b-8d94-e02aecacfb38 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-fb44c263-f492-42a6-a862-d3ffd7f75ac4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:36.232013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:36.232872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:36.233661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 207/432] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:36.240726 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c263-f492-42a6-a862-d3ffd7f75ac4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:36.267936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542b52-224c-452e-8c20-9d3d8f60f1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:36.268672 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542b52-224c-452e-8c20-9d3d8f60f1ce None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.268953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542b52-224c-452e-8c20-9d3d8f60f1ce None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.269221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542b52-224c-452e-8c20-9d3d8f60f1ce None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.270429 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542b52-224c-452e-8c20-9d3d8f60f1ce None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:36.272014 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542b52-224c-452e-8c20-9d3d8f60f1ce None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:36.274064 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 226/433] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:36 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:36.279731 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542b52-224c-452e-8c20-9d3d8f60f1ce None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:36.358398 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44c263-f492-42a6-a862-d3ffd7f75ac4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:36.401262 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f264a-5f85-4feb-9c5d-6a78e2fe2f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:36.402116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f264a-5f85-4feb-9c5d-6a78e2fe2f3d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.402791 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f264a-5f85-4feb-9c5d-6a78e2fe2f3d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.403220 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f264a-5f85-4feb-9c5d-6a78e2fe2f3d None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.404058 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f264a-5f85-4feb-9c5d-6a78e2fe2f3d None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:36.404517 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f264a-5f85-4feb-9c5d-6a78e2fe2f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:36.405444 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542b52-224c-452e-8c20-9d3d8f60f1ce None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:36.406312 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f264a-5f85-4feb-9c5d-6a78e2fe2f3d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:36.413422 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:36.420326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 208/434] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:15:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:36.427029 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f264a-5f85-4feb-9c5d-6a78e2fe2f3d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:36.449511 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c388580-1549-445d-a338-6cc596f93ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:36.450113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c388580-1549-445d-a338-6cc596f93ed2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.450390 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c388580-1549-445d-a338-6cc596f93ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.450716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c388580-1549-445d-a338-6cc596f93ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.451406 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c388580-1549-445d-a338-6cc596f93ed2 None admin] RBAC: Adding query filter params (group.id=c85c4d8261804b6aa09acd8350f37f27, role.id=75e4b5f3154e45059ce3a6449ac4ba3e, scope.project.id=acffc2592e8c40299db4c5bf775f0ca2) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:36.451714 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c388580-1549-445d-a338-6cc596f93ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:36.453152 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c388580-1549-445d-a338-6cc596f93ed2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:36.465948 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 227/435] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 11 18:15:36 2022] GET /identity/v3/role_assignments?group.id=c85c4d8261804b6aa09acd8350f37f27&scope.project.id=acffc2592e8c40299db4c5bf775f0ca2&role.id=75e4b5f3154e45059ce3a6449ac4ba3e => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:36.545753 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f264a-5f85-4feb-9c5d-6a78e2fe2f3d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:36.567124 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85ed5c-5fd4-40e4-92ec-70bd1de401b2 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.567447 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85ed5c-5fd4-40e4-92ec-70bd1de401b2 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.567688 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85ed5c-5fd4-40e4-92ec-70bd1de401b2 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.569425 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 228/436] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:15:36.575998 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5114f-9308-4315-b512-9e5412e4dd16 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.576320 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5114f-9308-4315-b512-9e5412e4dd16 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.576553 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5114f-9308-4315-b512-9e5412e4dd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.589220 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6408d0a-d140-4d03-842b-ef768a74c530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:36.589848 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6408d0a-d140-4d03-842b-ef768a74c530 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.590261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6408d0a-d140-4d03-842b-ef768a74c530 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.590839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:36.591232 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6408d0a-d140-4d03-842b-ef768a74c530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.598131 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-e7e5114f-9308-4315-b512-9e5412e4dd16 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:36.605079 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-e7e5114f-9308-4315-b512-9e5412e4dd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:36.682151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:36.684233 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 229/437] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:36.685007 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6408d0a-d140-4d03-842b-ef768a74c530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:36.686634 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6408d0a-d140-4d03-842b-ef768a74c530 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:36.735447 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6640e-fff8-4353-adf6-7f86651331ba None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.735980 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6640e-fff8-4353-adf6-7f86651331ba None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.736270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6640e-fff8-4353-adf6-7f86651331ba None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.737867 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 230/438] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:36.744540 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5e24-1440-4635-a1dd-d5af644d8b59 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.744841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5e24-1440-4635-a1dd-d5af644d8b59 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.745118 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5e24-1440-4635-a1dd-d5af644d8b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.766801 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-c38d5e24-1440-4635-a1dd-d5af644d8b59 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:36.767999 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-c38d5e24-1440-4635-a1dd-d5af644d8b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:36.823669 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 209/439] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:36.830170 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6408d0a-d140-4d03-842b-ef768a74c530 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:36.866420 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 231/440] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:36.940273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:36.943742 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6408d0a-d140-4d03-842b-ef768a74c530 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:36.984000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360feeb2-e2a8-41a9-9570-f9a0a1b52d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:36.985051 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360feeb2-e2a8-41a9-9570-f9a0a1b52d65 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:36.985549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360feeb2-e2a8-41a9-9570-f9a0a1b52d65 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:36.986026 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360feeb2-e2a8-41a9-9570-f9a0a1b52d65 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:36.987385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360feeb2-e2a8-41a9-9570-f9a0a1b52d65 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:36.989033 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360feeb2-e2a8-41a9-9570-f9a0a1b52d65 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:36.991205 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 210/441] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:36 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:36.996802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d5e24-1440-4635-a1dd-d5af644d8b59 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:37.023155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360feeb2-e2a8-41a9-9570-f9a0a1b52d65 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:37.075559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:37.114091 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d5e24-1440-4635-a1dd-d5af644d8b59 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:37.139496 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360feeb2-e2a8-41a9-9570-f9a0a1b52d65 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:37.152831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afa157-85d8-4033-8b80-72d42149746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:37.153595 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afa157-85d8-4033-8b80-72d42149746e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:37.154214 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afa157-85d8-4033-8b80-72d42149746e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:37.154518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afa157-85d8-4033-8b80-72d42149746e None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:37.155912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afa157-85d8-4033-8b80-72d42149746e None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:37.157814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afa157-85d8-4033-8b80-72d42149746e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:37.164681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 232/442] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:36 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:37.165726 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afa157-85d8-4033-8b80-72d42149746e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:37.174154 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb82700-ebe9-41a2-b7b0-b3beb5559fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:37.174873 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb82700-ebe9-41a2-b7b0-b3beb5559fd2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:37.175154 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb82700-ebe9-41a2-b7b0-b3beb5559fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:37.175425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb82700-ebe9-41a2-b7b0-b3beb5559fd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:37.186142 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb82700-ebe9-41a2-b7b0-b3beb5559fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-4cb82700-ebe9-41a2-b7b0-b3beb5559fd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:37.191084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:37.191974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:37.192813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 211/443] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:15:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:37.197866 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb82700-ebe9-41a2-b7b0-b3beb5559fd2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:37.227941 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:37.270502 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afa157-85d8-4033-8b80-72d42149746e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:37.298904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb82700-ebe9-41a2-b7b0-b3beb5559fd2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:37.303214 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0f27b-25f4-47f1-a3e5-fc1e74bf78b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:37.303810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0f27b-25f4-47f1-a3e5-fc1e74bf78b2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:37.304093 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0f27b-25f4-47f1-a3e5-fc1e74bf78b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:37.304370 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0f27b-25f4-47f1-a3e5-fc1e74bf78b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:37.305736 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0f27b-25f4-47f1-a3e5-fc1e74bf78b2 None admin] RBAC: Adding query filter params (group.id=c85c4d8261804b6aa09acd8350f37f27, role.id=1e94f00bf0f044b89bc9bd8dab18e2fa, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:37.306046 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0f27b-25f4-47f1-a3e5-fc1e74bf78b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:37.307500 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0f27b-25f4-47f1-a3e5-fc1e74bf78b2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:37.309243 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:37.313636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 233/444] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 11 18:15:37 2022] GET /identity/v3/role_assignments?group.id=c85c4d8261804b6aa09acd8350f37f27&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=1e94f00bf0f044b89bc9bd8dab18e2fa => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:37.314422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0f27b-25f4-47f1-a3e5-fc1e74bf78b2 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:37.335737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99792c-a37c-4fe3-94e2-88f7c1805301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:37.336393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99792c-a37c-4fe3-94e2-88f7c1805301 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:37.336676 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99792c-a37c-4fe3-94e2-88f7c1805301 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:37.337040 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99792c-a37c-4fe3-94e2-88f7c1805301 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:37.337723 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99792c-a37c-4fe3-94e2-88f7c1805301 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:37.338023 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99792c-a37c-4fe3-94e2-88f7c1805301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:37.339479 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99792c-a37c-4fe3-94e2-88f7c1805301 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:37.349060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 212/445] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:37.355516 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99792c-a37c-4fe3-94e2-88f7c1805301 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:37.435124 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0f27b-25f4-47f1-a3e5-fc1e74bf78b2 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:37.459569 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:37.470337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99792c-a37c-4fe3-94e2-88f7c1805301 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:37.471444 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf773c58-21f1-4a7f-990c-8d07d6f83aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:37.472091 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf773c58-21f1-4a7f-990c-8d07d6f83aaa None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:37.472368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf773c58-21f1-4a7f-990c-8d07d6f83aaa None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:37.472645 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf773c58-21f1-4a7f-990c-8d07d6f83aaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:37.484559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf773c58-21f1-4a7f-990c-8d07d6f83aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-bf773c58-21f1-4a7f-990c-8d07d6f83aaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:37.489810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:37.490871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:37.491681 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 234/446] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:15:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:37.497883 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf773c58-21f1-4a7f-990c-8d07d6f83aaa None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:37.516031 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af25b26-b05b-4278-a766-62f99ed9a60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:37.516643 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af25b26-b05b-4278-a766-62f99ed9a60e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:37.516922 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af25b26-b05b-4278-a766-62f99ed9a60e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:37.517196 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af25b26-b05b-4278-a766-62f99ed9a60e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:37.569343 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:37.600416 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af25b26-b05b-4278-a766-62f99ed9a60e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:37.602568 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af25b26-b05b-4278-a766-62f99ed9a60e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:37.623423 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf773c58-21f1-4a7f-990c-8d07d6f83aaa None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:37.667113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609468-9e5f-4e3b-991f-d3e27cb8e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:37.668563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609468-9e5f-4e3b-991f-d3e27cb8e50d None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:37.668563 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609468-9e5f-4e3b-991f-d3e27cb8e50d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:37.668930 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609468-9e5f-4e3b-991f-d3e27cb8e50d None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:37.669744 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd609468-9e5f-4e3b-991f-d3e27cb8e50d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:37.670258 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd609468-9e5f-4e3b-991f-d3e27cb8e50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:37.673874 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd609468-9e5f-4e3b-991f-d3e27cb8e50d None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:37.685810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 235/447] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:37.693074 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609468-9e5f-4e3b-991f-d3e27cb8e50d None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:37.719633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:37.735129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 213/448] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 18:15:37.736233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af25b26-b05b-4278-a766-62f99ed9a60e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:37.803287 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd609468-9e5f-4e3b-991f-d3e27cb8e50d None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:37.825771 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:37.835010 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af25b26-b05b-4278-a766-62f99ed9a60e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:37.840047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60aa25-7126-4fd0-9bf9-adb97f6ba938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:37.840651 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60aa25-7126-4fd0-9bf9-adb97f6ba938 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:37.840936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60aa25-7126-4fd0-9bf9-adb97f6ba938 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:37.841215 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60aa25-7126-4fd0-9bf9-adb97f6ba938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:37.873969 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a16a83-62ab-416e-9fd0-4e08cb8dc2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:37.874595 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a16a83-62ab-416e-9fd0-4e08cb8dc2b7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:37.874913 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a16a83-62ab-416e-9fd0-4e08cb8dc2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:37.875187 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a16a83-62ab-416e-9fd0-4e08cb8dc2b7 None admin] PATH_INFO: `/v3/projects/ed5c02b35e89464a8e8356e42fbf5165` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:37.876315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a16a83-62ab-416e-9fd0-4e08cb8dc2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5c02b35e89464a8e8356e42fbf5165)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:37.877739 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a16a83-62ab-416e-9fd0-4e08cb8dc2b7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:37.879387 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 214/449] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:37 2022] GET /identity/v3/projects/ed5c02b35e89464a8e8356e42fbf5165 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:37.884811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a16a83-62ab-416e-9fd0-4e08cb8dc2b7 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:37.912780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60aa25-7126-4fd0-9bf9-adb97f6ba938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:37.914863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60aa25-7126-4fd0-9bf9-adb97f6ba938 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:37.942090 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:37.983928 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a16a83-62ab-416e-9fd0-4e08cb8dc2b7 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:38.012720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 236/450] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 18:15:38.017275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036fd83-148a-4f2c-bfa7-108db3617580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:38.017902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036fd83-148a-4f2c-bfa7-108db3617580 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:38.018058 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60aa25-7126-4fd0-9bf9-adb97f6ba938 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:38.018181 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036fd83-148a-4f2c-bfa7-108db3617580 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:38.018453 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036fd83-148a-4f2c-bfa7-108db3617580 None admin] PATH_INFO: `/v3/groups/c85c4d8261804b6aa09acd8350f37f27` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:38.019671 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036fd83-148a-4f2c-bfa7-108db3617580 None admin] RBAC: Authorizing `identity:get_group(group_id=c85c4d8261804b6aa09acd8350f37f27)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:38.021268 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036fd83-148a-4f2c-bfa7-108db3617580 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:38.028338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 215/451] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:37 2022] GET /identity/v3/groups/c85c4d8261804b6aa09acd8350f37f27 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:38.029127 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036fd83-148a-4f2c-bfa7-108db3617580 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:38.038399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:38.117067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60aa25-7126-4fd0-9bf9-adb97f6ba938 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:38.127601 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036fd83-148a-4f2c-bfa7-108db3617580 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:38.150521 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc863d1-c423-4df0-ab29-6cb08b70c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:38.151165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc863d1-c423-4df0-ab29-6cb08b70c8af None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:38.151448 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc863d1-c423-4df0-ab29-6cb08b70c8af None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:38.151715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc863d1-c423-4df0-ab29-6cb08b70c8af None admin] PATH_INFO: `/v3/projects/83c912d6fcae45219e4abbd9eb74f129` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:38.152826 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc863d1-c423-4df0-ab29-6cb08b70c8af None admin] RBAC: Authorizing `identity:get_project(project_id=83c912d6fcae45219e4abbd9eb74f129)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:38.153577 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:38.154254 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc863d1-c423-4df0-ab29-6cb08b70c8af None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:38.155901 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 237/452] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Aug 11 18:15:38 2022] GET /identity/v3/projects/83c912d6fcae45219e4abbd9eb74f129 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:38.161546 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc863d1-c423-4df0-ab29-6cb08b70c8af None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:38.162884 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb89b-8468-4043-93c0-d692e8b80c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:38.162884 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb89b-8468-4043-93c0-d692e8b80c36 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:38.163074 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb89b-8468-4043-93c0-d692e8b80c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:38.163238 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb89b-8468-4043-93c0-d692e8b80c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:38.164226 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb89b-8468-4043-93c0-d692e8b80c36 None admin] RBAC: Adding query filter params (group.id=c85c4d8261804b6aa09acd8350f37f27, role.id=75e4b5f3154e45059ce3a6449ac4ba3e, scope.project.id=ed5c02b35e89464a8e8356e42fbf5165) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:38.164538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb89b-8468-4043-93c0-d692e8b80c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:38.166847 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb89b-8468-4043-93c0-d692e8b80c36 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:38.172665 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 216/453] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 11 18:15:38 2022] GET /identity/v3/role_assignments?group.id=c85c4d8261804b6aa09acd8350f37f27&scope.project.id=ed5c02b35e89464a8e8356e42fbf5165&role.id=75e4b5f3154e45059ce3a6449ac4ba3e => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:38.255137 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:38.267964 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc863d1-c423-4df0-ab29-6cb08b70c8af None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:38.304175 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1026624-c197-44e6-be29-369385b18f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:38.304846 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1026624-c197-44e6-be29-369385b18f7c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:38.305131 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1026624-c197-44e6-be29-369385b18f7c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:38.305399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1026624-c197-44e6-be29-369385b18f7c None admin] PATH_INFO: `/v3/groups/a391f1c0739e44ee968beabd7b84a302` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:38.306555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1026624-c197-44e6-be29-369385b18f7c None admin] RBAC: Authorizing `identity:get_group(group_id=a391f1c0739e44ee968beabd7b84a302)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:38.308049 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1026624-c197-44e6-be29-369385b18f7c None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:38.309696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 238/454] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Aug 11 18:15:38 2022] GET /identity/v3/groups/a391f1c0739e44ee968beabd7b84a302 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:38.315689 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb89b-8468-4043-93c0-d692e8b80c36 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:38.425371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb89b-8468-4043-93c0-d692e8b80c36 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:38.460007 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aeb618-7478-44db-b36d-45d938a106aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:38.460664 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeb618-7478-44db-b36d-45d938a106aa None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:38.462081 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeb618-7478-44db-b36d-45d938a106aa None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:38.462363 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeb618-7478-44db-b36d-45d938a106aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:38.463122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aeb618-7478-44db-b36d-45d938a106aa None admin] RBAC: Adding query filter params (group.id=a391f1c0739e44ee968beabd7b84a302, role.id=f89efd1f713043d8835c127de30f53ca, scope.project.id=83c912d6fcae45219e4abbd9eb74f129) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:38.463427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aeb618-7478-44db-b36d-45d938a106aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:38.464862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aeb618-7478-44db-b36d-45d938a106aa None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:38.470575 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 217/455] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Aug 11 18:15:38 2022] GET /identity/v3/role_assignments?group.id=a391f1c0739e44ee968beabd7b84a302&scope.project.id=83c912d6fcae45219e4abbd9eb74f129&role.id=f89efd1f713043d8835c127de30f53ca => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:41.013922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfd688-0b05-4e06-8f6b-2010273831fa None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.014485 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfd688-0b05-4e06-8f6b-2010273831fa None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.014485 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfd688-0b05-4e06-8f6b-2010273831fa None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.015820 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 239/456] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:41.021819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ac424-bd94-476f-bf2f-78949cde641d None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.023427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ac424-bd94-476f-bf2f-78949cde641d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.024055 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ac424-bd94-476f-bf2f-78949cde641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.043580 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-996ac424-bd94-476f-bf2f-78949cde641d None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:41.045215 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-996ac424-bd94-476f-bf2f-78949cde641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:41.097911 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:41.116073 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 218/457] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:41.180024 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dea9d-5161-4064-8062-fbb885e2d412 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.180644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dea9d-5161-4064-8062-fbb885e2d412 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.181119 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dea9d-5161-4064-8062-fbb885e2d412 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.182931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 240/458] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:41.188563 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e782e-956e-427a-8f66-05ac2958ddf7 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.189112 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e782e-956e-427a-8f66-05ac2958ddf7 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.189611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e782e-956e-427a-8f66-05ac2958ddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.208780 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6b2e782e-956e-427a-8f66-05ac2958ddf7 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:41.210294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6b2e782e-956e-427a-8f66-05ac2958ddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:41.282580 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 219/459] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:41.299216 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d162594-7e81-47c9-b764-c9ba7df163b9 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.299813 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d162594-7e81-47c9-b764-c9ba7df163b9 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.300277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d162594-7e81-47c9-b764-c9ba7df163b9 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.301761 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 241/460] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:41.310116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1b1f7-7e5b-4983-8cea-0dd1cf7ca64e None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.310643 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1b1f7-7e5b-4983-8cea-0dd1cf7ca64e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.311187 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1b1f7-7e5b-4983-8cea-0dd1cf7ca64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.329924 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-69f1b1f7-7e5b-4983-8cea-0dd1cf7ca64e None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:41.331142 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-69f1b1f7-7e5b-4983-8cea-0dd1cf7ca64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:41.400393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 220/461] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:41.466546 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d162594-7e81-47c9-b764-c9ba7df163b9 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:41.578336 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d162594-7e81-47c9-b764-c9ba7df163b9 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:41.614403 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501711fb-04eb-4a42-a80b-4c49ae21323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:41.615385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501711fb-04eb-4a42-a80b-4c49ae21323e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.615954 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501711fb-04eb-4a42-a80b-4c49ae21323e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.616460 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501711fb-04eb-4a42-a80b-4c49ae21323e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.622221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1b1f7-7e5b-4983-8cea-0dd1cf7ca64e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:41.628662 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501711fb-04eb-4a42-a80b-4c49ae21323e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:41.630133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501711fb-04eb-4a42-a80b-4c49ae21323e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-501711fb-04eb-4a42-a80b-4c49ae21323e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:41.646689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:41.647666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:41.648584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:41.648584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:41.648584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:41.648584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 242/462] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:41.653937 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501711fb-04eb-4a42-a80b-4c49ae21323e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:41.667402 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:41.678841 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:41.741426 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1b1f7-7e5b-4983-8cea-0dd1cf7ca64e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:41.765752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501711fb-04eb-4a42-a80b-4c49ae21323e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:41.778805 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a47c4-7eb9-474d-bffb-289107ecf2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:41.779438 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a47c4-7eb9-474d-bffb-289107ecf2c1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.779721 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a47c4-7eb9-474d-bffb-289107ecf2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.779996 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a47c4-7eb9-474d-bffb-289107ecf2c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.790092 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a47c4-7eb9-474d-bffb-289107ecf2c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:41.791583 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a47c4-7eb9-474d-bffb-289107ecf2c1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:41.797739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c9db3-7451-42f1-9016-95fda59a86c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:41.798326 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c9db3-7451-42f1-9016-95fda59a86c2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.798599 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c9db3-7451-42f1-9016-95fda59a86c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.798899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c9db3-7451-42f1-9016-95fda59a86c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.799533 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c9db3-7451-42f1-9016-95fda59a86c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:41.799831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c9db3-7451-42f1-9016-95fda59a86c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:41.801173 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c9db3-7451-42f1-9016-95fda59a86c2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-919a47c4-7eb9-474d-bffb-289107ecf2c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:41.806475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:41.807406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:41.808449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:41.808449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:41.808449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:41.808449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 221/463] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:41.810431 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92456465-23e0-4142-a6d0-1283c11e5a3f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.810755 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92456465-23e0-4142-a6d0-1283c11e5a3f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.811040 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92456465-23e0-4142-a6d0-1283c11e5a3f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.812507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 222/464] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:41.813248 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92456465-23e0-4142-a6d0-1283c11e5a3f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:41.816138 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 243/465] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:41.816895 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c9db3-7451-42f1-9016-95fda59a86c2 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:41.882089 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:41.914640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:41.914833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c9db3-7451-42f1-9016-95fda59a86c2 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:41.921178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92456465-23e0-4142-a6d0-1283c11e5a3f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:41.949084 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d2377-8399-4a16-9240-7250c6424dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:41.949676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d2377-8399-4a16-9240-7250c6424dad None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.949959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d2377-8399-4a16-9240-7250c6424dad None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.950232 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d2377-8399-4a16-9240-7250c6424dad None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.950890 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d2377-8399-4a16-9240-7250c6424dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:41.951193 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d2377-8399-4a16-9240-7250c6424dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:41.952558 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d2377-8399-4a16-9240-7250c6424dad None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:41.955317 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a233b2-2cf3-45b5-9b2c-fb5a46d58164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:41.955940 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a233b2-2cf3-45b5-9b2c-fb5a46d58164 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.956220 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a233b2-2cf3-45b5-9b2c-fb5a46d58164 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.956493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a233b2-2cf3-45b5-9b2c-fb5a46d58164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.963952 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 244/466] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:41.965094 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49cfb0-4fd3-43f4-a914-2860e86f95d5 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:41.965382 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49cfb0-4fd3-43f4-a914-2860e86f95d5 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:41.965660 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49cfb0-4fd3-43f4-a914-2860e86f95d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:41.966596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a233b2-2cf3-45b5-9b2c-fb5a46d58164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:41.968074 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a233b2-2cf3-45b5-9b2c-fb5a46d58164 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:41.984036 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-bc49cfb0-4fd3-43f4-a914-2860e86f95d5 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-b1a233b2-2cf3-45b5-9b2c-fb5a46d58164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:41.984211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:41.985075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:41.985934 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:41.985934 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:41.985934 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:41.986097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-bc49cfb0-4fd3-43f4-a914-2860e86f95d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:41.986165 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 223/467] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:41.986165 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a233b2-2cf3-45b5-9b2c-fb5a46d58164 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:42.052056 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 245/468] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:42.052885 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49cfb0-4fd3-43f4-a914-2860e86f95d5 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:42.096568 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a233b2-2cf3-45b5-9b2c-fb5a46d58164 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:42.119768 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:42.136660 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd45e5d-961f-49e3-ba7e-2085e8d7fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:42.137941 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45e5d-961f-49e3-ba7e-2085e8d7fe43 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:42.138412 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45e5d-961f-49e3-ba7e-2085e8d7fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:42.139239 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd45e5d-961f-49e3-ba7e-2085e8d7fe43 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:42.140068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd45e5d-961f-49e3-ba7e-2085e8d7fe43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:42.142229 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd45e5d-961f-49e3-ba7e-2085e8d7fe43 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:42.162237 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49cfb0-4fd3-43f4-a914-2860e86f95d5 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:42.196444 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7fc76-680b-45b6-9cb9-3606bf8b64e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:42.197038 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7fc76-680b-45b6-9cb9-3606bf8b64e3 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:42.197318 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7fc76-680b-45b6-9cb9-3606bf8b64e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:42.197616 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7fc76-680b-45b6-9cb9-3606bf8b64e3 None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:42.198246 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7fc76-680b-45b6-9cb9-3606bf8b64e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:42.199709 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7fc76-680b-45b6-9cb9-3606bf8b64e3 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:42.264639 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 224/469] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:15:41 2022] POST /identity/v3/users => generated 246 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:15:42.265467 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd45e5d-961f-49e3-ba7e-2085e8d7fe43 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:42.276446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:42.302715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 246/470] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:15:42 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:15:42.386849 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7fc76-680b-45b6-9cb9-3606bf8b64e3 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:42.416490 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd45e5d-961f-49e3-ba7e-2085e8d7fe43 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:42.458442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4004-27ab-45af-b7a3-75ceb81f6ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:42.459168 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4004-27ab-45af-b7a3-75ceb81f6ae1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:42.459449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4004-27ab-45af-b7a3-75ceb81f6ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:42.459728 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4004-27ab-45af-b7a3-75ceb81f6ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:42.460877 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4004-27ab-45af-b7a3-75ceb81f6ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:42.461878 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4004-27ab-45af-b7a3-75ceb81f6ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:42.463364 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4004-27ab-45af-b7a3-75ceb81f6ae1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:42.479024 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 225/471] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:42.485611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4004-27ab-45af-b7a3-75ceb81f6ae1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:42.532418 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7fc76-680b-45b6-9cb9-3606bf8b64e3 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:42.557778 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:42.566314 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:42.577403 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891de3e-2107-40e1-a304-585bfe275bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:42.578766 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891de3e-2107-40e1-a304-585bfe275bf8 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:42.578766 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891de3e-2107-40e1-a304-585bfe275bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:42.578766 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891de3e-2107-40e1-a304-585bfe275bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:42.594592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891de3e-2107-40e1-a304-585bfe275bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:42.596161 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891de3e-2107-40e1-a304-585bfe275bf8 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-9891de3e-2107-40e1-a304-585bfe275bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:42.615780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:42.619053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:42.619941 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:42.619941 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:42.619941 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:42.620107 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4004-27ab-45af-b7a3-75ceb81f6ae1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:42.620187 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 247/472] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:42.624803 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891de3e-2107-40e1-a304-585bfe275bf8 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:42.666517 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc7ef-3fe0-4906-938b-91a829e12c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:42.667117 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc7ef-3fe0-4906-938b-91a829e12c42 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:42.667687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc7ef-3fe0-4906-938b-91a829e12c42 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:42.668103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc7ef-3fe0-4906-938b-91a829e12c42 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:42.668762 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bc7ef-3fe0-4906-938b-91a829e12c42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:42.670257 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bc7ef-3fe0-4906-938b-91a829e12c42 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:42.753774 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891de3e-2107-40e1-a304-585bfe275bf8 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:42.790049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 226/473] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:15:42 2022] POST /identity/v3/users => generated 248 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:15:42.799095 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64138ddf-a181-4d11-ab96-0a6afff8dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:42.799095 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64138ddf-a181-4d11-ab96-0a6afff8dd89 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:42.799095 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64138ddf-a181-4d11-ab96-0a6afff8dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:42.799095 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64138ddf-a181-4d11-ab96-0a6afff8dd89 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:42.799524 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64138ddf-a181-4d11-ab96-0a6afff8dd89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:42.799524 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64138ddf-a181-4d11-ab96-0a6afff8dd89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:42.799648 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64138ddf-a181-4d11-ab96-0a6afff8dd89 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:42.816651 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 248/474] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:42.824064 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc7ef-3fe0-4906-938b-91a829e12c42 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:42.953660 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc7ef-3fe0-4906-938b-91a829e12c42 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:42.977543 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:42.993797 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23a3d7-4702-4f7e-9c52-dc5d804bccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:42.994631 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a3d7-4702-4f7e-9c52-dc5d804bccc7 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:42.995108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a3d7-4702-4f7e-9c52-dc5d804bccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:42.995530 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a3d7-4702-4f7e-9c52-dc5d804bccc7 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:42.996388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23a3d7-4702-4f7e-9c52-dc5d804bccc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:42.998234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23a3d7-4702-4f7e-9c52-dc5d804bccc7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:43.094818 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 227/475] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:15:42 2022] POST /identity/v3/users => generated 249 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:15:44.682028 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33878eb3-4ef9-4c80-be0b-1b7974b3d046 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:44.682577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33878eb3-4ef9-4c80-be0b-1b7974b3d046 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:44.682577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33878eb3-4ef9-4c80-be0b-1b7974b3d046 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:44.684080 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 249/476] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:44.685406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96eb65-afb3-4c3a-9e19-e630bf893f04 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:44.685772 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96eb65-afb3-4c3a-9e19-e630bf893f04 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:44.685955 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96eb65-afb3-4c3a-9e19-e630bf893f04 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:44.687515 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 228/477] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:44.691213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507e43-b609-480c-8c25-cd9f505e50c7 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:44.691499 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507e43-b609-480c-8c25-cd9f505e50c7 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:44.691776 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507e43-b609-480c-8c25-cd9f505e50c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:44.693729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61edff8-04b3-48c8-8a4c-7a0340df5085 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:44.694261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61edff8-04b3-48c8-8a4c-7a0340df5085 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:44.695357 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61edff8-04b3-48c8-8a4c-7a0340df5085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:44.710882 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-33507e43-b609-480c-8c25-cd9f505e50c7 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:44.712430 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-33507e43-b609-480c-8c25-cd9f505e50c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:44.717287 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-e61edff8-04b3-48c8-8a4c-7a0340df5085 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:44.718526 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-e61edff8-04b3-48c8-8a4c-7a0340df5085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:44.735515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:44.794071 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 250/478] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:44.807590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 229/479] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:45.068635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd0af-03a5-4ae1-adb6-28d35c49c323 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.069373 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd0af-03a5-4ae1-adb6-28d35c49c323 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.069858 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd0af-03a5-4ae1-adb6-28d35c49c323 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.071791 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 251/480] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:45.077277 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72fd5d-44c2-4824-a588-2912b5826e67 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.077802 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72fd5d-44c2-4824-a588-2912b5826e67 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.078313 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72fd5d-44c2-4824-a588-2912b5826e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.101688 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6d72fd5d-44c2-4824-a588-2912b5826e67 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:45.103121 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6d72fd5d-44c2-4824-a588-2912b5826e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:45.137100 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abd0af-03a5-4ae1-adb6-28d35c49c323 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:45.182509 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 230/481] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:45.183455 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72fd5d-44c2-4824-a588-2912b5826e67 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:45.235082 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:45.269418 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abd0af-03a5-4ae1-adb6-28d35c49c323 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:45.304701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72fd5d-44c2-4824-a588-2912b5826e67 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:45.315382 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acc462-0a69-4a7c-a81f-ebf1d203d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:45.316050 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acc462-0a69-4a7c-a81f-ebf1d203d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.316338 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acc462-0a69-4a7c-a81f-ebf1d203d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.316617 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acc462-0a69-4a7c-a81f-ebf1d203d2b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.331232 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acc462-0a69-4a7c-a81f-ebf1d203d2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-d9acc462-0a69-4a7c-a81f-ebf1d203d2b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:45.336749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:45.337664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:45.338484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:45.340638 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 252/482] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:45.346359 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acc462-0a69-4a7c-a81f-ebf1d203d2b1 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:45.354045 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c16b03-0346-46c7-a64a-10af627f32b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:45.354890 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c16b03-0346-46c7-a64a-10af627f32b7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.355228 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c16b03-0346-46c7-a64a-10af627f32b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.355509 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c16b03-0346-46c7-a64a-10af627f32b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.367032 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c16b03-0346-46c7-a64a-10af627f32b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:45.371371 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-c0c16b03-0346-46c7-a64a-10af627f32b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:45.372810 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:45.373713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:45.374551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 231/483] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:45.380528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd0243-65a3-4f21-aeeb-56657fa3900b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.380814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd0243-65a3-4f21-aeeb-56657fa3900b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.381261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd0243-65a3-4f21-aeeb-56657fa3900b None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.383161 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 232/484] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:15:45.385502 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd0243-65a3-4f21-aeeb-56657fa3900b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:45.461931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acc462-0a69-4a7c-a81f-ebf1d203d2b1 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:45.487213 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:45.495441 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd0243-65a3-4f21-aeeb-56657fa3900b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:45.496365 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cbbc1-df86-45c6-b0c5-9646999e0e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:45.499790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cbbc1-df86-45c6-b0c5-9646999e0e11 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.499790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cbbc1-df86-45c6-b0c5-9646999e0e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.499790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cbbc1-df86-45c6-b0c5-9646999e0e11 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.499790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cbbc1-df86-45c6-b0c5-9646999e0e11 None admin] RBAC: Adding query filter params (name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:45.499790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cbbc1-df86-45c6-b0c5-9646999e0e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:45.500117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cbbc1-df86-45c6-b0c5-9646999e0e11 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:45.509122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 253/485] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:45.510133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639abf5-80b3-4790-bd5d-867477eb0b42 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.510418 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639abf5-80b3-4790-bd5d-867477eb0b42 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.510710 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639abf5-80b3-4790-bd5d-867477eb0b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.528487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-4639abf5-80b3-4790-bd5d-867477eb0b42 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:45.529721 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-4639abf5-80b3-4790-bd5d-867477eb0b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:45.538416 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2719b2-18fe-49d5-8046-e80cf84d7f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:45.539275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2719b2-18fe-49d5-8046-e80cf84d7f93 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.539559 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2719b2-18fe-49d5-8046-e80cf84d7f93 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.539827 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2719b2-18fe-49d5-8046-e80cf84d7f93 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.540479 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2719b2-18fe-49d5-8046-e80cf84d7f93 None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:45.540778 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2719b2-18fe-49d5-8046-e80cf84d7f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:45.542137 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2719b2-18fe-49d5-8046-e80cf84d7f93 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:45.550213 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 233/486] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:45.551046 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2719b2-18fe-49d5-8046-e80cf84d7f93 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:45.598239 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 254/487] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:45.599025 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639abf5-80b3-4790-bd5d-867477eb0b42 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:45.610069 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:45.656421 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2719b2-18fe-49d5-8046-e80cf84d7f93 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:45.693312 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744e0d-df8d-4350-9ff5-862e88c31fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:45.693951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744e0d-df8d-4350-9ff5-862e88c31fbd None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.694259 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744e0d-df8d-4350-9ff5-862e88c31fbd None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.694534 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744e0d-df8d-4350-9ff5-862e88c31fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.704670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639abf5-80b3-4790-bd5d-867477eb0b42 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:45.706277 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3744e0d-df8d-4350-9ff5-862e88c31fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:45.707846 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3744e0d-df8d-4350-9ff5-862e88c31fbd None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-d3744e0d-df8d-4350-9ff5-862e88c31fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:45.722485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:45.723666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:45.724543 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:45.724543 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:45.724543 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:45.724543 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 234/488] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:45.724767 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744e0d-df8d-4350-9ff5-862e88c31fbd None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:45.746476 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:45.755627 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c7c6d-7aca-48b5-a264-2986cb8f900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:45.756259 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c7c6d-7aca-48b5-a264-2986cb8f900d None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.757103 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c7c6d-7aca-48b5-a264-2986cb8f900d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.757103 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c7c6d-7aca-48b5-a264-2986cb8f900d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.767131 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c7c6d-7aca-48b5-a264-2986cb8f900d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-5b2c7c6d-7aca-48b5-a264-2986cb8f900d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:45.771876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:45.772798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:45.773622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 255/489] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:45.774290 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c7c6d-7aca-48b5-a264-2986cb8f900d None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:45.846017 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744e0d-df8d-4350-9ff5-862e88c31fbd None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:45.852302 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:45.939224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c7c6d-7aca-48b5-a264-2986cb8f900d None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:45.940230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62076-6e0e-415e-b80c-084830ce4a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:45.940854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62076-6e0e-415e-b80c-084830ce4a57 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.941136 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62076-6e0e-415e-b80c-084830ce4a57 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.941410 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62076-6e0e-415e-b80c-084830ce4a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.952230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f62076-6e0e-415e-b80c-084830ce4a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:45.953673 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f62076-6e0e-415e-b80c-084830ce4a57 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-e9f62076-6e0e-415e-b80c-084830ce4a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:45.968385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:45.969370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:45.970235 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:45.970235 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:45.970235 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:45.970235 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 235/490] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:45.970235 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62076-6e0e-415e-b80c-084830ce4a57 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:45.978444 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563cede-b85f-40fe-8dd8-5c1f9046fc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:45.979077 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563cede-b85f-40fe-8dd8-5c1f9046fc39 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:45.979357 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563cede-b85f-40fe-8dd8-5c1f9046fc39 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:45.979626 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563cede-b85f-40fe-8dd8-5c1f9046fc39 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:45.980265 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563cede-b85f-40fe-8dd8-5c1f9046fc39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:45.980569 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563cede-b85f-40fe-8dd8-5c1f9046fc39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:45.981961 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563cede-b85f-40fe-8dd8-5c1f9046fc39 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:45.994106 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 256/491] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:45.994933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563cede-b85f-40fe-8dd8-5c1f9046fc39 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.033669 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:46.072335 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62076-6e0e-415e-b80c-084830ce4a57 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.093581 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563cede-b85f-40fe-8dd8-5c1f9046fc39 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.105589 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9d756-c693-4604-a539-e96129804ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.106194 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9d756-c693-4604-a539-e96129804ab8 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.106507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9d756-c693-4604-a539-e96129804ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.106804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9d756-c693-4604-a539-e96129804ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.107463 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9d756-c693-4604-a539-e96129804ab8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:46.107821 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9d756-c693-4604-a539-e96129804ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:46.109199 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9d756-c693-4604-a539-e96129804ab8 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:46.117452 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 236/492] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:46.118293 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9d756-c693-4604-a539-e96129804ab8 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.120562 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:46.129230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640e319-9afa-4ecd-ae35-a5a6bbe5982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.132561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640e319-9afa-4ecd-ae35-a5a6bbe5982e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.132561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640e319-9afa-4ecd-ae35-a5a6bbe5982e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.132561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640e319-9afa-4ecd-ae35-a5a6bbe5982e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.141122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640e319-9afa-4ecd-ae35-a5a6bbe5982e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-1640e319-9afa-4ecd-ae35-a5a6bbe5982e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:46.145841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:46.146850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:46.147747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 257/493] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:46.148403 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640e319-9afa-4ecd-ae35-a5a6bbe5982e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.219775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9d756-c693-4604-a539-e96129804ab8 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.244191 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:46.247580 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640e319-9afa-4ecd-ae35-a5a6bbe5982e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.254899 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd2346-4416-4156-a44c-6c1b7f6bfc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.255504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd2346-4416-4156-a44c-6c1b7f6bfc96 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.255789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd2346-4416-4156-a44c-6c1b7f6bfc96 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.256063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd2346-4416-4156-a44c-6c1b7f6bfc96 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.257309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd2346-4416-4156-a44c-6c1b7f6bfc96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:46.257746 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd2346-4416-4156-a44c-6c1b7f6bfc96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:46.259264 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd2346-4416-4156-a44c-6c1b7f6bfc96 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:46.270902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 237/494] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:46.271812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd2346-4416-4156-a44c-6c1b7f6bfc96 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.281709 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1a136-3c72-4a96-84d8-eccf0589d469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.282328 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1a136-3c72-4a96-84d8-eccf0589d469 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.282602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1a136-3c72-4a96-84d8-eccf0589d469 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.282902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1a136-3c72-4a96-84d8-eccf0589d469 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.289894 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1a136-3c72-4a96-84d8-eccf0589d469 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:46.291355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1a136-3c72-4a96-84d8-eccf0589d469 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-e4e1a136-3c72-4a96-84d8-eccf0589d469 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:46.304277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:46.305306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 258/495] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:46.306202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1a136-3c72-4a96-84d8-eccf0589d469 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.357142 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:46.384858 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd2346-4416-4156-a44c-6c1b7f6bfc96 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.408164 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1a136-3c72-4a96-84d8-eccf0589d469 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.418896 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473baf-181b-4db6-9055-e06e6d71dbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.419513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473baf-181b-4db6-9055-e06e6d71dbe9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.419809 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473baf-181b-4db6-9055-e06e6d71dbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.420073 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473baf-181b-4db6-9055-e06e6d71dbe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.430346 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98473baf-181b-4db6-9055-e06e6d71dbe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:46.431834 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98473baf-181b-4db6-9055-e06e6d71dbe9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:46.441652 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377c941-821c-4835-9220-eebe97627024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.442249 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377c941-821c-4835-9220-eebe97627024 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.442535 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377c941-821c-4835-9220-eebe97627024 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.442850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377c941-821c-4835-9220-eebe97627024 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.443515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377c941-821c-4835-9220-eebe97627024 None admin] RBAC: Adding query filter params (name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:46.443841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377c941-821c-4835-9220-eebe97627024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:46.445220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377c941-821c-4835-9220-eebe97627024 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-98473baf-181b-4db6-9055-e06e6d71dbe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:46.445989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:46.446929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:46.447773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:46.447773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:46.447773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:46.447773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 238/496] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:46.447997 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473baf-181b-4db6-9055-e06e6d71dbe9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.460417 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 259/497] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:46.460672 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377c941-821c-4835-9220-eebe97627024 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.486920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:46.551673 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473baf-181b-4db6-9055-e06e6d71dbe9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.560802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377c941-821c-4835-9220-eebe97627024 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.571182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:46.586607 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e259f-fac7-4750-b52e-5af0c7240c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.587263 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e259f-fac7-4750-b52e-5af0c7240c8d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.587542 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e259f-fac7-4750-b52e-5af0c7240c8d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.587818 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e259f-fac7-4750-b52e-5af0c7240c8d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.594969 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f4798-dfe5-4f45-8980-c018599538cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.595605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4798-dfe5-4f45-8980-c018599538cb None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.599661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e259f-fac7-4750-b52e-5af0c7240c8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:46.599767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4798-dfe5-4f45-8980-c018599538cb None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.599767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4798-dfe5-4f45-8980-c018599538cb None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.599767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f4798-dfe5-4f45-8980-c018599538cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:46.599767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f4798-dfe5-4f45-8980-c018599538cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:46.600060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e259f-fac7-4750-b52e-5af0c7240c8d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:46.600144 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f4798-dfe5-4f45-8980-c018599538cb None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-bf7e259f-fac7-4750-b52e-5af0c7240c8d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:46.611687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:46.612637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 239/498] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:46.618887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e259f-fac7-4750-b52e-5af0c7240c8d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.637587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 260/499] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:46.638422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f4798-dfe5-4f45-8980-c018599538cb None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.712645 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:46.718443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e259f-fac7-4750-b52e-5af0c7240c8d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.742553 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f4798-dfe5-4f45-8980-c018599538cb None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.756611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec9f6-cd10-40d4-9e35-6f2ba0941e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.757203 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec9f6-cd10-40d4-9e35-6f2ba0941e51 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.757628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec9f6-cd10-40d4-9e35-6f2ba0941e51 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.757903 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec9f6-cd10-40d4-9e35-6f2ba0941e51 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.758531 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec9f6-cd10-40d4-9e35-6f2ba0941e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:46.758868 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec9f6-cd10-40d4-9e35-6f2ba0941e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:46.760237 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec9f6-cd10-40d4-9e35-6f2ba0941e51 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:46.771530 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 240/500] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:46.772847 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec9f6-cd10-40d4-9e35-6f2ba0941e51 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.782654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46945dc-972a-4f1d-9edd-c9224c04ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.783301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46945dc-972a-4f1d-9edd-c9224c04ef89 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.783581 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46945dc-972a-4f1d-9edd-c9224c04ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.783853 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46945dc-972a-4f1d-9edd-c9224c04ef89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.794314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46945dc-972a-4f1d-9edd-c9224c04ef89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:46.795783 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46945dc-972a-4f1d-9edd-c9224c04ef89 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-a46945dc-972a-4f1d-9edd-c9224c04ef89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:46.809912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:46.810889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:46.811741 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:46.811741 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:46.811741 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:46.811741 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 261/501] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:46.812280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46945dc-972a-4f1d-9edd-c9224c04ef89 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.833203 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:46.872155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec9f6-cd10-40d4-9e35-6f2ba0941e51 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.905737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf57773-2f6b-4d3f-8a3b-f7e7d68850d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.906341 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf57773-2f6b-4d3f-8a3b-f7e7d68850d8 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.906624 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf57773-2f6b-4d3f-8a3b-f7e7d68850d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.906938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf57773-2f6b-4d3f-8a3b-f7e7d68850d8 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.907661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf57773-2f6b-4d3f-8a3b-f7e7d68850d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:46.907972 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf57773-2f6b-4d3f-8a3b-f7e7d68850d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:46.909434 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf57773-2f6b-4d3f-8a3b-f7e7d68850d8 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:46.910763 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46945dc-972a-4f1d-9edd-c9224c04ef89 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:46.944839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06ce9e-9bb6-480e-8021-f98750c1fee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:46.945382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 241/502] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:46.945510 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06ce9e-9bb6-480e-8021-f98750c1fee3 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:46.945693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06ce9e-9bb6-480e-8021-f98750c1fee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:46.945967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06ce9e-9bb6-480e-8021-f98750c1fee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:46.946226 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf57773-2f6b-4d3f-8a3b-f7e7d68850d8 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:46.961664 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:47.014676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06ce9e-9bb6-480e-8021-f98750c1fee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:47.016196 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06ce9e-9bb6-480e-8021-f98750c1fee3 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:47.036897 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:47.046384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf57773-2f6b-4d3f-8a3b-f7e7d68850d8 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:47.081104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b8b84-cbd3-4c7d-89eb-3bc8f41ca523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:47.081723 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8b84-cbd3-4c7d-89eb-3bc8f41ca523 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:47.082005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8b84-cbd3-4c7d-89eb-3bc8f41ca523 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:47.082278 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8b84-cbd3-4c7d-89eb-3bc8f41ca523 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:47.089725 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b8b84-cbd3-4c7d-89eb-3bc8f41ca523 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:47.091219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b8b84-cbd3-4c7d-89eb-3bc8f41ca523 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-e60b8b84-cbd3-4c7d-89eb-3bc8f41ca523 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:47.102923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:47.103888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 242/503] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:47.104789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b8b84-cbd3-4c7d-89eb-3bc8f41ca523 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:47.124597 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 262/504] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:47.125374 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06ce9e-9bb6-480e-8021-f98750c1fee3 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:47.181468 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:47.205736 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b8b84-cbd3-4c7d-89eb-3bc8f41ca523 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:47.222900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06ce9e-9bb6-480e-8021-f98750c1fee3 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:47.239998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0018e2e-b243-41c5-9f03-f477316e77d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:47.240595 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0018e2e-b243-41c5-9f03-f477316e77d5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:47.240879 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0018e2e-b243-41c5-9f03-f477316e77d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:47.241227 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0018e2e-b243-41c5-9f03-f477316e77d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:47.241949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0018e2e-b243-41c5-9f03-f477316e77d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:47.242153 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:47.242282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0018e2e-b243-41c5-9f03-f477316e77d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:47.243663 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0018e2e-b243-41c5-9f03-f477316e77d5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:47.255857 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a82482-05e6-4156-b27e-36303de2177e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:47.257184 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82482-05e6-4156-b27e-36303de2177e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:47.257462 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 243/505] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:47.258327 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0018e2e-b243-41c5-9f03-f477316e77d5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:47.258810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82482-05e6-4156-b27e-36303de2177e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:47.259127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82482-05e6-4156-b27e-36303de2177e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:47.325809 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a82482-05e6-4156-b27e-36303de2177e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:47.327309 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a82482-05e6-4156-b27e-36303de2177e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:47.356162 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0018e2e-b243-41c5-9f03-f477316e77d5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:47.391385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1ba72-a136-4024-a7eb-193781b6084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:47.391911 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1ba72-a136-4024-a7eb-193781b6084f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:47.392197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1ba72-a136-4024-a7eb-193781b6084f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:47.392468 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1ba72-a136-4024-a7eb-193781b6084f None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:47.393195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1ba72-a136-4024-a7eb-193781b6084f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:47.393495 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1ba72-a136-4024-a7eb-193781b6084f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:47.394933 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1ba72-a136-4024-a7eb-193781b6084f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:47.396539 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:47.412752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 244/506] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 11 18:15:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:47.413421 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1ba72-a136-4024-a7eb-193781b6084f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:47.424971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 263/507] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:47.425797 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a82482-05e6-4156-b27e-36303de2177e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:47.446720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:47.514913 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1ba72-a136-4024-a7eb-193781b6084f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:47.524781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a82482-05e6-4156-b27e-36303de2177e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:47.547984 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e7477-892c-4741-90af-f7426f02de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:47.548632 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e7477-892c-4741-90af-f7426f02de3d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:47.548911 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e7477-892c-4741-90af-f7426f02de3d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:47.549185 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e7477-892c-4741-90af-f7426f02de3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:47.558171 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157254d-c64e-4c24-b09c-2df5f98a9d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:47.558833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157254d-c64e-4c24-b09c-2df5f98a9d62 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:47.559117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157254d-c64e-4c24-b09c-2df5f98a9d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:47.559398 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157254d-c64e-4c24-b09c-2df5f98a9d62 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:47.559776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e7477-892c-4741-90af-f7426f02de3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:47.561225 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e7477-892c-4741-90af-f7426f02de3d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:47.566433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157254d-c64e-4c24-b09c-2df5f98a9d62 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:47.567903 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157254d-c64e-4c24-b09c-2df5f98a9d62 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-b20e7477-892c-4741-90af-f7426f02de3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:47.576146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:47.577049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:47.577902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:47.577902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:47.577902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:47.577902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 245/508] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:47.578117 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e7477-892c-4741-90af-f7426f02de3d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-8157254d-c64e-4c24-b09c-2df5f98a9d62 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:47.579827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:47.580728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 264/509] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:47.582015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157254d-c64e-4c24-b09c-2df5f98a9d62 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:47.626319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:47.662483 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:47.681260 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157254d-c64e-4c24-b09c-2df5f98a9d62 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:47.681596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e7477-892c-4741-90af-f7426f02de3d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:47.715023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48befe2b-ab23-46e1-835c-94136597965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:47.715632 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48befe2b-ab23-46e1-835c-94136597965c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:47.715912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48befe2b-ab23-46e1-835c-94136597965c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:47.716025 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582043-41cb-4950-baff-d87daa91fd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:47.716462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48befe2b-ab23-46e1-835c-94136597965c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:47.716579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582043-41cb-4950-baff-d87daa91fd78 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:47.716865 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582043-41cb-4950-baff-d87daa91fd78 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:47.717141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582043-41cb-4950-baff-d87daa91fd78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:47.726758 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48befe2b-ab23-46e1-835c-94136597965c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:47.728212 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48befe2b-ab23-46e1-835c-94136597965c None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-48befe2b-ab23-46e1-835c-94136597965c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:47.743478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:47.750018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:47.751416 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:47.751416 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:47.751416 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:47.751416 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 265/510] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:47.751416 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48befe2b-ab23-46e1-835c-94136597965c None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:47.788393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582043-41cb-4950-baff-d87daa91fd78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:47.789861 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582043-41cb-4950-baff-d87daa91fd78 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:47.837889 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:47.847414 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48befe2b-ab23-46e1-835c-94136597965c None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:47.877385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:47.882298 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24673528-a8de-40e5-9fa0-b56a658895f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:47.882922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24673528-a8de-40e5-9fa0-b56a658895f3 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:47.883205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24673528-a8de-40e5-9fa0-b56a658895f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:47.883479 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24673528-a8de-40e5-9fa0-b56a658895f3 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:47.884114 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24673528-a8de-40e5-9fa0-b56a658895f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:47.884418 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24673528-a8de-40e5-9fa0-b56a658895f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:47.885787 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24673528-a8de-40e5-9fa0-b56a658895f3 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:47.893967 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 246/511] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:47.895010 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582043-41cb-4950-baff-d87daa91fd78 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:47.901613 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 266/512] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:47.901613 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24673528-a8de-40e5-9fa0-b56a658895f3 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:47.996097 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582043-41cb-4950-baff-d87daa91fd78 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.000178 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24673528-a8de-40e5-9fa0-b56a658895f3 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.029982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc8981-eb31-4014-8688-296b024eb05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.030580 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc8981-eb31-4014-8688-296b024eb05c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.030892 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc8981-eb31-4014-8688-296b024eb05c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.031167 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc8981-eb31-4014-8688-296b024eb05c None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.031881 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc8981-eb31-4014-8688-296b024eb05c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:48.032187 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc8981-eb31-4014-8688-296b024eb05c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.033184 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97405-2852-4f9d-839a-79c60e77dba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.033628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc8981-eb31-4014-8688-296b024eb05c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.033770 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97405-2852-4f9d-839a-79c60e77dba8 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.034050 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97405-2852-4f9d-839a-79c60e77dba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.034321 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97405-2852-4f9d-839a-79c60e77dba8 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.034974 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f97405-2852-4f9d-839a-79c60e77dba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:48.035277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f97405-2852-4f9d-839a-79c60e77dba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.036635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f97405-2852-4f9d-839a-79c60e77dba8 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.048539 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 267/513] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:48.049525 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97405-2852-4f9d-839a-79c60e77dba8 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.056389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 247/514] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Aug 11 18:15:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:48.056389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc8981-eb31-4014-8688-296b024eb05c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.056389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:48.104888 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:48.152800 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97405-2852-4f9d-839a-79c60e77dba8 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.156798 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc8981-eb31-4014-8688-296b024eb05c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.187596 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4f53a-0ec7-4937-9f2a-7fcd4fef74c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.188207 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4f53a-0ec7-4937-9f2a-7fcd4fef74c5 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.188488 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4f53a-0ec7-4937-9f2a-7fcd4fef74c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.188760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4f53a-0ec7-4937-9f2a-7fcd4fef74c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.190697 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbbbb6-53a0-46f9-a311-006219e0ba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.191414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbbbb6-53a0-46f9-a311-006219e0ba86 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.191703 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbbbb6-53a0-46f9-a311-006219e0ba86 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.191975 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbbbb6-53a0-46f9-a311-006219e0ba86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.198681 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbbbb6-53a0-46f9-a311-006219e0ba86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.199110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4f53a-0ec7-4937-9f2a-7fcd4fef74c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.200129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbbbb6-53a0-46f9-a311-006219e0ba86 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.200536 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4f53a-0ec7-4937-9f2a-7fcd4fef74c5 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-00cbbbb6-53a0-46f9-a311-006219e0ba86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:15:48.212144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:48.213151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:48.218895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:15:48.218895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:15:48.218895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:15:48.218895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:15:48.218895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:15:48.218895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:15:48.218895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:48.218895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:48.218895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 248/515] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:48.218895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbbbb6-53a0-46f9-a311-006219e0ba86 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-8da4f53a-0ec7-4937-9f2a-7fcd4fef74c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:48.219463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:48.220300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:48.221312 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:48.221312 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:48.221312 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:48.221312 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 268/516] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:48.221312 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4f53a-0ec7-4937-9f2a-7fcd4fef74c5 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.281477 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:48.315896 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4f53a-0ec7-4937-9f2a-7fcd4fef74c5 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.318182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:48.319309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbbbb6-53a0-46f9-a311-006219e0ba86 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.351570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab586a-e4a1-45da-bda4-ffb420f844ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.352183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab586a-e4a1-45da-bda4-ffb420f844ef None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.352470 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab586a-e4a1-45da-bda4-ffb420f844ef None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.352735 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab586a-e4a1-45da-bda4-ffb420f844ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.353746 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673aa2f-5c6c-4afa-a154-052ff395f6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.354348 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673aa2f-5c6c-4afa-a154-052ff395f6e7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.354631 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673aa2f-5c6c-4afa-a154-052ff395f6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.354938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673aa2f-5c6c-4afa-a154-052ff395f6e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.359439 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab586a-e4a1-45da-bda4-ffb420f844ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.360906 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab586a-e4a1-45da-bda4-ffb420f844ef None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-e8ab586a-e4a1-45da-bda4-ffb420f844ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:15:48.373266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:48.374296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:48.375392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:15:48.375392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:15:48.375392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:15:48.375392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:15:48.375392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:15:48.375392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:15:48.375392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:48.375392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:48.375392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 269/517] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:48.375962 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab586a-e4a1-45da-bda4-ffb420f844ef None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.426132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673aa2f-5c6c-4afa-a154-052ff395f6e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.427601 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673aa2f-5c6c-4afa-a154-052ff395f6e7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.477554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab586a-e4a1-45da-bda4-ffb420f844ef None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.487761 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:48.512794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72338d8c-b260-4090-ba0e-a694732c6537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.513476 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72338d8c-b260-4090-ba0e-a694732c6537 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.513757 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72338d8c-b260-4090-ba0e-a694732c6537 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.514030 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72338d8c-b260-4090-ba0e-a694732c6537 None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.514765 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72338d8c-b260-4090-ba0e-a694732c6537 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:48.515072 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72338d8c-b260-4090-ba0e-a694732c6537 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.516501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72338d8c-b260-4090-ba0e-a694732c6537 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.527733 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 249/518] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:48.528597 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673aa2f-5c6c-4afa-a154-052ff395f6e7 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.540366 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 270/519] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:48.540366 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72338d8c-b260-4090-ba0e-a694732c6537 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.562903 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:48.628967 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673aa2f-5c6c-4afa-a154-052ff395f6e7 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.637719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72338d8c-b260-4090-ba0e-a694732c6537 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.664038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7ad28-8086-42ad-a710-fa8414d72b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.664629 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7ad28-8086-42ad-a710-fa8414d72b53 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.664905 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7ad28-8086-42ad-a710-fa8414d72b53 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.665177 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7ad28-8086-42ad-a710-fa8414d72b53 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.665805 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7ad28-8086-42ad-a710-fa8414d72b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:48.666109 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7ad28-8086-42ad-a710-fa8414d72b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.667517 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7ad28-8086-42ad-a710-fa8414d72b53 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.676303 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51875a-960b-4dde-ad7d-9498d71979f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.676887 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51875a-960b-4dde-ad7d-9498d71979f8 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.677164 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51875a-960b-4dde-ad7d-9498d71979f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.677431 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51875a-960b-4dde-ad7d-9498d71979f8 None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.678102 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51875a-960b-4dde-ad7d-9498d71979f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:48.679135 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51875a-960b-4dde-ad7d-9498d71979f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.684254 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 250/520] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:48.684254 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7ad28-8086-42ad-a710-fa8414d72b53 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.684484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51875a-960b-4dde-ad7d-9498d71979f8 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.691973 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 271/521] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:48.692640 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51875a-960b-4dde-ad7d-9498d71979f8 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.706637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:48.780181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:48.786343 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7ad28-8086-42ad-a710-fa8414d72b53 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.796131 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51875a-960b-4dde-ad7d-9498d71979f8 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.819525 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c3cc-fd7f-46e6-b631-b2359a076d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.820426 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c3cc-fd7f-46e6-b631-b2359a076d56 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.820710 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c3cc-fd7f-46e6-b631-b2359a076d56 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.820983 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c3cc-fd7f-46e6-b631-b2359a076d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.829715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573636cf-de43-46c0-bddb-b288dd6d6453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:48.830306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573636cf-de43-46c0-bddb-b288dd6d6453 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:48.830591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573636cf-de43-46c0-bddb-b288dd6d6453 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:48.830893 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573636cf-de43-46c0-bddb-b288dd6d6453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:48.831606 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573636cf-de43-46c0-bddb-b288dd6d6453 None admin] RBAC: Adding query filter params (role.id=762ed046c04e4a16ade8c5e989710fa2, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=685c28640ca84d2b8e85d47e64430cc0) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:48.831705 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315c3cc-fd7f-46e6-b631-b2359a076d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.831913 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573636cf-de43-46c0-bddb-b288dd6d6453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:48.833121 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315c3cc-fd7f-46e6-b631-b2359a076d56 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.833309 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573636cf-de43-46c0-bddb-b288dd6d6453 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:48.839173 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 272/522] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/role_assignments?user.id=685c28640ca84d2b8e85d47e64430cc0&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=762ed046c04e4a16ade8c5e989710fa2 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:48.839951 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573636cf-de43-46c0-bddb-b288dd6d6453 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-2315c3cc-fd7f-46e6-b631-b2359a076d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:48.848949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:48.854900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:48.855926 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:48.855926 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:48.855926 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:48.855926 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 251/523] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:48.855926 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c3cc-fd7f-46e6-b631-b2359a076d56 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:48.948002 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:48.969345 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573636cf-de43-46c0-bddb-b288dd6d6453 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:48.981606 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c3cc-fd7f-46e6-b631-b2359a076d56 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:49.013170 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43907f29-b7c0-4184-a6d5-b12fec8f60d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:49.013804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43907f29-b7c0-4184-a6d5-b12fec8f60d7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:49.014088 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43907f29-b7c0-4184-a6d5-b12fec8f60d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:49.014361 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43907f29-b7c0-4184-a6d5-b12fec8f60d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:49.021908 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43907f29-b7c0-4184-a6d5-b12fec8f60d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:49.023875 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43907f29-b7c0-4184-a6d5-b12fec8f60d7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:49.026246 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad86eea-1661-4d32-a20c-b465c595ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:49.026916 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad86eea-1661-4d32-a20c-b465c595ea96 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:49.027204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad86eea-1661-4d32-a20c-b465c595ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:49.027482 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad86eea-1661-4d32-a20c-b465c595ea96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:49.028319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad86eea-1661-4d32-a20c-b465c595ea96 None admin] RBAC: Adding query filter params (role.id=762ed046c04e4a16ade8c5e989710fa2, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=cc7c47252a3e4bc4b592475797aa202a) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:49.032149 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad86eea-1661-4d32-a20c-b465c595ea96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:49.032149 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad86eea-1661-4d32-a20c-b465c595ea96 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-43907f29-b7c0-4184-a6d5-b12fec8f60d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:15:49.035408 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:49.036286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:49.037146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:15:49.037146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:15:49.037146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:15:49.037146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:15:49.037146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:15:49.037146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:15:49.037146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:49.037146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:49.037664 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 252/524] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/role_assignments?user.id=cc7c47252a3e4bc4b592475797aa202a&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=762ed046c04e4a16ade8c5e989710fa2 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:49.037741 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 273/525] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:49.039065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad86eea-1661-4d32-a20c-b465c595ea96 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:49.043063 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43907f29-b7c0-4184-a6d5-b12fec8f60d7 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:49.063072 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:49.183828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad86eea-1661-4d32-a20c-b465c595ea96 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:49.184762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43907f29-b7c0-4184-a6d5-b12fec8f60d7 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:49.223914 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9872c-1d27-4508-96d9-6737f87483cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:49.224621 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9872c-1d27-4508-96d9-6737f87483cc None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:49.224901 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9872c-1d27-4508-96d9-6737f87483cc None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:49.225295 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9872c-1d27-4508-96d9-6737f87483cc None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:49.226144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596936a-f03e-41cc-8ee8-cfae954ac9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:49.226488 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9872c-1d27-4508-96d9-6737f87483cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:49.226875 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9872c-1d27-4508-96d9-6737f87483cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:49.227355 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596936a-f03e-41cc-8ee8-cfae954ac9c5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:49.227806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596936a-f03e-41cc-8ee8-cfae954ac9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:49.228253 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596936a-f03e-41cc-8ee8-cfae954ac9c5 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:49.228362 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9872c-1d27-4508-96d9-6737f87483cc None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:49.229212 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596936a-f03e-41cc-8ee8-cfae954ac9c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:49.229706 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596936a-f03e-41cc-8ee8-cfae954ac9c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:49.231447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596936a-f03e-41cc-8ee8-cfae954ac9c5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:49.241696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 274/526] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:49.242925 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:49.246820 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 253/527] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:49.248134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9872c-1d27-4508-96d9-6737f87483cc None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:49.252579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596936a-f03e-41cc-8ee8-cfae954ac9c5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:49.323626 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:49.366774 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596936a-f03e-41cc-8ee8-cfae954ac9c5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:49.372344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9872c-1d27-4508-96d9-6737f87483cc None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:49.403003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85029f3e-25e8-4db1-bcc8-49d8dc8d2197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:49.403627 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029f3e-25e8-4db1-bcc8-49d8dc8d2197 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:49.403906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029f3e-25e8-4db1-bcc8-49d8dc8d2197 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:49.404181 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029f3e-25e8-4db1-bcc8-49d8dc8d2197 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:49.411315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85029f3e-25e8-4db1-bcc8-49d8dc8d2197 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:49.413297 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85029f3e-25e8-4db1-bcc8-49d8dc8d2197 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:49.418587 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b5637-77c7-4ce0-8f8c-7614cbceffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:49.419454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b5637-77c7-4ce0-8f8c-7614cbceffff None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:49.420166 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b5637-77c7-4ce0-8f8c-7614cbceffff None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:49.420617 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b5637-77c7-4ce0-8f8c-7614cbceffff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:49.421595 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b5637-77c7-4ce0-8f8c-7614cbceffff None admin] RBAC: Adding query filter params (role.id=762ed046c04e4a16ade8c5e989710fa2, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=8f3f1554e540472ca6e38f65a1401d59) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:49.422174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b5637-77c7-4ce0-8f8c-7614cbceffff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:49.423822 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b5637-77c7-4ce0-8f8c-7614cbceffff None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-85029f3e-25e8-4db1-bcc8-49d8dc8d2197 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:15:49.425411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:49.426265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:49.427331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:15:49.427331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:15:49.427331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:15:49.427331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:15:49.427331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:15:49.427331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:15:49.427331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:49.427331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:49.427331 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 254/528] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:49.433338 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 275/529] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:49 2022] GET /identity/v3/role_assignments?user.id=8f3f1554e540472ca6e38f65a1401d59&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=762ed046c04e4a16ade8c5e989710fa2 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:49.439923 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85029f3e-25e8-4db1-bcc8-49d8dc8d2197 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:49.509006 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:49.557819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85029f3e-25e8-4db1-bcc8-49d8dc8d2197 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:49.594360 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29543986-c01e-47f3-b20d-84a1d662ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:49.594925 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29543986-c01e-47f3-b20d-84a1d662ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:49.595209 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29543986-c01e-47f3-b20d-84a1d662ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:49.595485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29543986-c01e-47f3-b20d-84a1d662ffe7 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:49.596183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29543986-c01e-47f3-b20d-84a1d662ffe7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:49.596492 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29543986-c01e-47f3-b20d-84a1d662ffe7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:49.598034 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29543986-c01e-47f3-b20d-84a1d662ffe7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:49.625036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 255/530] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:49.630904 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b5637-77c7-4ce0-8f8c-7614cbceffff None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:49.742103 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b5637-77c7-4ce0-8f8c-7614cbceffff None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:49.775097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:49.779606 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec84a7-e1fa-4ccd-8cf6-dd40d1f364f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:49.780287 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec84a7-e1fa-4ccd-8cf6-dd40d1f364f3 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:49.780824 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec84a7-e1fa-4ccd-8cf6-dd40d1f364f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:49.780824 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec84a7-e1fa-4ccd-8cf6-dd40d1f364f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:49.781653 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec84a7-e1fa-4ccd-8cf6-dd40d1f364f3 None admin] RBAC: Adding query filter params (role.id=762ed046c04e4a16ade8c5e989710fa2, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=55256cb1c7f743ffa544dbd388103ab2) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:49.781969 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec84a7-e1fa-4ccd-8cf6-dd40d1f364f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:49.783449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec84a7-e1fa-4ccd-8cf6-dd40d1f364f3 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:49.789867 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 276/531] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:15:49 2022] GET /identity/v3/role_assignments?user.id=55256cb1c7f743ffa544dbd388103ab2&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=762ed046c04e4a16ade8c5e989710fa2 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:51.196932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf1478-bd9a-4abe-aee6-fa3a75ed7374 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:51.197896 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf1478-bd9a-4abe-aee6-fa3a75ed7374 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:51.198380 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf1478-bd9a-4abe-aee6-fa3a75ed7374 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:51.200187 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 256/532] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:51.205731 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031d086-ac1e-4711-b3d7-26074e6ddc81 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:51.206548 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031d086-ac1e-4711-b3d7-26074e6ddc81 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:51.207067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031d086-ac1e-4711-b3d7-26074e6ddc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:51.226398 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-1031d086-ac1e-4711-b3d7-26074e6ddc81 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:51.227982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-1031d086-ac1e-4711-b3d7-26074e6ddc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:51.306564 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 277/533] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:51.409320 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8fabb-b244-448d-a907-e2160042e24c None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:51.409668 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8fabb-b244-448d-a907-e2160042e24c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:51.409873 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8fabb-b244-448d-a907-e2160042e24c None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:51.411509 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 257/534] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:51.416718 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105111-022c-4abb-957d-ab2af94ed4b1 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:51.417256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105111-022c-4abb-957d-ab2af94ed4b1 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:51.417731 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f105111-022c-4abb-957d-ab2af94ed4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:51.441593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-9f105111-022c-4abb-957d-ab2af94ed4b1 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:51.442822 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-9f105111-022c-4abb-957d-ab2af94ed4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:51.513800 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 278/535] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:15:51.644836 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8fabb-b244-448d-a907-e2160042e24c None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:51.754327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85fb7a-ae0d-4a08-8738-e5d228b57e52 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:51.754618 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85fb7a-ae0d-4a08-8738-e5d228b57e52 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:51.754922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85fb7a-ae0d-4a08-8738-e5d228b57e52 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:51.757009 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 279/536] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:51.759206 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8fabb-b244-448d-a907-e2160042e24c None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:51.762058 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf812be0-fe28-4189-a767-9125be1005e5 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:51.762347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf812be0-fe28-4189-a767-9125be1005e5 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:51.762623 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf812be0-fe28-4189-a767-9125be1005e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:51.781196 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-bf812be0-fe28-4189-a767-9125be1005e5 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:51.782305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-bf812be0-fe28-4189-a767-9125be1005e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:51.799135 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f42670-f654-45d9-af9f-1bf6d6001032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:51.799976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f42670-f654-45d9-af9f-1bf6d6001032 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:51.800258 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f42670-f654-45d9-af9f-1bf6d6001032 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:51.800869 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f42670-f654-45d9-af9f-1bf6d6001032 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:51.803064 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:51.815899 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f42670-f654-45d9-af9f-1bf6d6001032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-25f42670-f654-45d9-af9f-1bf6d6001032 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:51.823603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:51.824533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:51.825385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 258/537] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:51.829727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f42670-f654-45d9-af9f-1bf6d6001032 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:51.839365 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:51.862963 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 280/538] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:51.871416 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf812be0-fe28-4189-a767-9125be1005e5 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:51.943222 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f42670-f654-45d9-af9f-1bf6d6001032 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:51.983162 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa57ba3-eff1-4067-871c-96085adccd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:51.983851 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa57ba3-eff1-4067-871c-96085adccd20 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:51.984454 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa57ba3-eff1-4067-871c-96085adccd20 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:51.984714 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa57ba3-eff1-4067-871c-96085adccd20 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:51.985384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa57ba3-eff1-4067-871c-96085adccd20 None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:51.985763 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa57ba3-eff1-4067-871c-96085adccd20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:51.987146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa57ba3-eff1-4067-871c-96085adccd20 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:52.001954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 259/539] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:52.003236 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa57ba3-eff1-4067-871c-96085adccd20 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.013306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf812be0-fe28-4189-a767-9125be1005e5 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.050957 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:52.056743 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ac4d-3399-49cd-9297-cb6a42ff8b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.057376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ac4d-3399-49cd-9297-cb6a42ff8b58 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.057745 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ac4d-3399-49cd-9297-cb6a42ff8b58 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.057921 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ac4d-3399-49cd-9297-cb6a42ff8b58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.069295 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250ac4d-3399-49cd-9297-cb6a42ff8b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-5250ac4d-3399-49cd-9297-cb6a42ff8b58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:52.074308 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:52.075221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:52.076023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:52.080300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 281/540] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:52.081420 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43d56-6dc0-4392-96b2-3ffdf7aed42b None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.081709 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43d56-6dc0-4392-96b2-3ffdf7aed42b None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.081991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43d56-6dc0-4392-96b2-3ffdf7aed42b None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.083524 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 282/541] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:52.084284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a43d56-6dc0-4392-96b2-3ffdf7aed42b None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.113452 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa57ba3-eff1-4067-871c-96085adccd20 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.134209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:52.150060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35834fd8-6a75-4e15-b66b-51aed1497aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.150690 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35834fd8-6a75-4e15-b66b-51aed1497aaa None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.150990 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35834fd8-6a75-4e15-b66b-51aed1497aaa None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.151264 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35834fd8-6a75-4e15-b66b-51aed1497aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.162477 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35834fd8-6a75-4e15-b66b-51aed1497aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:52.163979 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35834fd8-6a75-4e15-b66b-51aed1497aaa None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-35834fd8-6a75-4e15-b66b-51aed1497aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:52.179442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:52.180393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:52.181281 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:52.181281 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:52.181281 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:52.181281 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 260/542] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:52.182050 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee8bf6-368d-4076-8ad0-b1c049a00a7e None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.182050 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee8bf6-368d-4076-8ad0-b1c049a00a7e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.182186 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee8bf6-368d-4076-8ad0-b1c049a00a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.197976 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a43d56-6dc0-4392-96b2-3ffdf7aed42b None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.201430 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-31ee8bf6-368d-4076-8ad0-b1c049a00a7e None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:52.202762 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-31ee8bf6-368d-4076-8ad0-b1c049a00a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:52.234384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771e414-507d-42a6-9bd3-a4eeb19eab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.235013 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e414-507d-42a6-9bd3-a4eeb19eab82 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.235294 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e414-507d-42a6-9bd3-a4eeb19eab82 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.235569 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e414-507d-42a6-9bd3-a4eeb19eab82 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.236227 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771e414-507d-42a6-9bd3-a4eeb19eab82 None admin] RBAC: Adding query filter params (name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:52.236532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771e414-507d-42a6-9bd3-a4eeb19eab82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:52.238003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771e414-507d-42a6-9bd3-a4eeb19eab82 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:52.245954 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 283/543] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:52.246781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771e414-507d-42a6-9bd3-a4eeb19eab82 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.274042 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 261/544] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:52.274981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee8bf6-368d-4076-8ad0-b1c049a00a7e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.299014 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:52.352578 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771e414-507d-42a6-9bd3-a4eeb19eab82 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.361715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:52.374856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee8bf6-368d-4076-8ad0-b1c049a00a7e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.390256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a27a8-3222-4ae2-a869-e1094a5f67f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.391182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a27a8-3222-4ae2-a869-e1094a5f67f4 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.391535 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a27a8-3222-4ae2-a869-e1094a5f67f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.391812 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a27a8-3222-4ae2-a869-e1094a5f67f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.392450 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a27a8-3222-4ae2-a869-e1094a5f67f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:52.392758 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a27a8-3222-4ae2-a869-e1094a5f67f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:52.394117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a27a8-3222-4ae2-a869-e1094a5f67f4 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:52.412421 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 284/545] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:52.412421 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a27a8-3222-4ae2-a869-e1094a5f67f4 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.415264 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb9d16-a45c-460d-a1ec-fee4972ef420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.415908 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb9d16-a45c-460d-a1ec-fee4972ef420 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.416187 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb9d16-a45c-460d-a1ec-fee4972ef420 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.416462 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb9d16-a45c-460d-a1ec-fee4972ef420 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.426918 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb9d16-a45c-460d-a1ec-fee4972ef420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-01eb9d16-a45c-460d-a1ec-fee4972ef420 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:52.431633 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:52.432513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:52.433326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 262/546] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:52.433980 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb9d16-a45c-460d-a1ec-fee4972ef420 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.525253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a27a8-3222-4ae2-a869-e1094a5f67f4 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.526868 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:52.546328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb9d16-a45c-460d-a1ec-fee4972ef420 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.561843 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334901c6-e427-4a5c-b418-ce2bd0abde74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.562205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334901c6-e427-4a5c-b418-ce2bd0abde74 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.562491 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334901c6-e427-4a5c-b418-ce2bd0abde74 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.562875 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334901c6-e427-4a5c-b418-ce2bd0abde74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.573981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334901c6-e427-4a5c-b418-ce2bd0abde74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:52.575785 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334901c6-e427-4a5c-b418-ce2bd0abde74 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:52.583593 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccd291-2d3e-402c-ab8b-fa744d8829d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.584982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccd291-2d3e-402c-ab8b-fa744d8829d4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.585273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccd291-2d3e-402c-ab8b-fa744d8829d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.585544 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccd291-2d3e-402c-ab8b-fa744d8829d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.592758 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccd291-2d3e-402c-ab8b-fa744d8829d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-334901c6-e427-4a5c-b418-ce2bd0abde74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:52.593127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:52.594167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:52.595213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:52.595213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:52.595213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:52.595432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccd291-2d3e-402c-ab8b-fa744d8829d4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:52.595871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 285/547] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:52.596657 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334901c6-e427-4a5c-b418-ce2bd0abde74 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-0eccd291-2d3e-402c-ab8b-fa744d8829d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:52.609224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:52.610178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:52.611280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:52.611280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:52.611280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:52.611280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:52.611280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:52.611280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:52.611280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:52.611280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:52.611280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:15:52.611280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:52.613309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 263/548] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:52.613309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccd291-2d3e-402c-ab8b-fa744d8829d4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.621115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:52.699528 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334901c6-e427-4a5c-b418-ce2bd0abde74 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.718887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccd291-2d3e-402c-ab8b-fa744d8829d4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.734094 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285572c-5a3f-4bd0-a16e-1aa7662c88d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.734953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285572c-5a3f-4bd0-a16e-1aa7662c88d0 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.735397 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285572c-5a3f-4bd0-a16e-1aa7662c88d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.735833 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285572c-5a3f-4bd0-a16e-1aa7662c88d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.736500 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285572c-5a3f-4bd0-a16e-1aa7662c88d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:52.736812 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285572c-5a3f-4bd0-a16e-1aa7662c88d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:52.738740 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285572c-5a3f-4bd0-a16e-1aa7662c88d0 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:52.747532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 286/549] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:52.748346 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285572c-5a3f-4bd0-a16e-1aa7662c88d0 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.755399 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c9a0c-87df-4054-8578-6fc1482a632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.755997 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9a0c-87df-4054-8578-6fc1482a632a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.756391 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9a0c-87df-4054-8578-6fc1482a632a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.756917 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9a0c-87df-4054-8578-6fc1482a632a None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.757235 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c9a0c-87df-4054-8578-6fc1482a632a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:52.757538 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c9a0c-87df-4054-8578-6fc1482a632a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:52.758935 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c9a0c-87df-4054-8578-6fc1482a632a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:52.772862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 264/550] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:52.773669 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c9a0c-87df-4054-8578-6fc1482a632a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.776642 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:52.830610 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:52.848756 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285572c-5a3f-4bd0-a16e-1aa7662c88d0 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.872066 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c9a0c-87df-4054-8578-6fc1482a632a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:52.885570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac7764-471e-4198-8f86-fcbaf89b97da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.891792 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac7764-471e-4198-8f86-fcbaf89b97da None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.891792 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac7764-471e-4198-8f86-fcbaf89b97da None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.891792 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac7764-471e-4198-8f86-fcbaf89b97da None admin] PATH_INFO: `/v3/roles/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.897223 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac7764-471e-4198-8f86-fcbaf89b97da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-fcac7764-471e-4198-8f86-fcbaf89b97da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:52.902284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:52.903725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 287/551] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:52.904696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac7764-471e-4198-8f86-fcbaf89b97da None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.909336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5f9e-9339-4eee-9edb-a513fc45e268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:52.909921 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5f9e-9339-4eee-9edb-a513fc45e268 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:52.910198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5f9e-9339-4eee-9edb-a513fc45e268 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:52.910466 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5f9e-9339-4eee-9edb-a513fc45e268 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:52.911219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc5f9e-9339-4eee-9edb-a513fc45e268 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:52.911521 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc5f9e-9339-4eee-9edb-a513fc45e268 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:52.913854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc5f9e-9339-4eee-9edb-a513fc45e268 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:52.931818 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 265/552] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:52.932802 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5f9e-9339-4eee-9edb-a513fc45e268 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:52.991580 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:53.011573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac7764-471e-4198-8f86-fcbaf89b97da None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.032912 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5f9e-9339-4eee-9edb-a513fc45e268 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.045262 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97630134-1983-4067-aced-0caf16ba1dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.045959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97630134-1983-4067-aced-0caf16ba1dde None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.046302 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97630134-1983-4067-aced-0caf16ba1dde None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.046641 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97630134-1983-4067-aced-0caf16ba1dde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.057196 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97630134-1983-4067-aced-0caf16ba1dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.058642 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97630134-1983-4067-aced-0caf16ba1dde None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.060365 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:53.067588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72d293-8079-42ea-87f4-b9b3daf6f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.079366 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d293-8079-42ea-87f4-b9b3daf6f3cd None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.079366 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d293-8079-42ea-87f4-b9b3daf6f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.079366 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d293-8079-42ea-87f4-b9b3daf6f3cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-97630134-1983-4067-aced-0caf16ba1dde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:53.079739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:53.080716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:53.081605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:53.081605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:53.081605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:53.081605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 288/553] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:53.081605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97630134-1983-4067-aced-0caf16ba1dde None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.081880 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72d293-8079-42ea-87f4-b9b3daf6f3cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.081880 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72d293-8079-42ea-87f4-b9b3daf6f3cd None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-0b72d293-8079-42ea-87f4-b9b3daf6f3cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:53.089864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:53.090904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 266/554] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:53.091800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72d293-8079-42ea-87f4-b9b3daf6f3cd None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.183004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97630134-1983-4067-aced-0caf16ba1dde None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.189179 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72d293-8079-42ea-87f4-b9b3daf6f3cd None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.210371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:53.218001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56955a5-b158-4b4e-8c15-00c86e28d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.223644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56955a5-b158-4b4e-8c15-00c86e28d571 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.223644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56955a5-b158-4b4e-8c15-00c86e28d571 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.223644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56955a5-b158-4b4e-8c15-00c86e28d571 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.223644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56955a5-b158-4b4e-8c15-00c86e28d571 None admin] RBAC: Adding query filter params (name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:53.223644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56955a5-b158-4b4e-8c15-00c86e28d571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.223644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56955a5-b158-4b4e-8c15-00c86e28d571 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.224130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29e2e9-37cc-41eb-bf26-3a3ba0bcc849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.224701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29e2e9-37cc-41eb-bf26-3a3ba0bcc849 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.225011 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29e2e9-37cc-41eb-bf26-3a3ba0bcc849 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.225288 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29e2e9-37cc-41eb-bf26-3a3ba0bcc849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.229432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 289/555] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:53.230224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56955a5-b158-4b4e-8c15-00c86e28d571 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.238009 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29e2e9-37cc-41eb-bf26-3a3ba0bcc849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.239521 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29e2e9-37cc-41eb-bf26-3a3ba0bcc849 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-5a29e2e9-37cc-41eb-bf26-3a3ba0bcc849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:53.254267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:53.255461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:53.257063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:53.257063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:53.257063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:53.257063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 267/556] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:53.257063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29e2e9-37cc-41eb-bf26-3a3ba0bcc849 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.290866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:53.336815 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56955a5-b158-4b4e-8c15-00c86e28d571 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.357720 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29e2e9-37cc-41eb-bf26-3a3ba0bcc849 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.369472 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6728a-2571-49c4-97e4-c5e435a36068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.370072 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6728a-2571-49c4-97e4-c5e435a36068 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.370504 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6728a-2571-49c4-97e4-c5e435a36068 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.370818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6728a-2571-49c4-97e4-c5e435a36068 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.371453 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6728a-2571-49c4-97e4-c5e435a36068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:53.372009 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6728a-2571-49c4-97e4-c5e435a36068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.373363 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6728a-2571-49c4-97e4-c5e435a36068 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.385577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 290/557] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:53.386377 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6728a-2571-49c4-97e4-c5e435a36068 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.391578 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418cce6-7c76-4729-b1f6-95776c6d3a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.392171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418cce6-7c76-4729-b1f6-95776c6d3a02 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.392446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418cce6-7c76-4729-b1f6-95776c6d3a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.392716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418cce6-7c76-4729-b1f6-95776c6d3a02 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.393451 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418cce6-7c76-4729-b1f6-95776c6d3a02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:53.393753 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418cce6-7c76-4729-b1f6-95776c6d3a02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.395206 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418cce6-7c76-4729-b1f6-95776c6d3a02 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.414230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 268/558] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:53.414230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418cce6-7c76-4729-b1f6-95776c6d3a02 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.442500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:53.491950 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6728a-2571-49c4-97e4-c5e435a36068 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.509133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:53.513925 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418cce6-7c76-4729-b1f6-95776c6d3a02 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.527316 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da278578-fcf9-442a-ba10-4c239d55f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.527936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da278578-fcf9-442a-ba10-4c239d55f365 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.528218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da278578-fcf9-442a-ba10-4c239d55f365 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.528490 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da278578-fcf9-442a-ba10-4c239d55f365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.538616 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da278578-fcf9-442a-ba10-4c239d55f365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.540306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da278578-fcf9-442a-ba10-4c239d55f365 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.547350 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc469ee-1df0-4692-bdab-6d6fa19f4dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.547939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc469ee-1df0-4692-bdab-6d6fa19f4dc3 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.548217 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc469ee-1df0-4692-bdab-6d6fa19f4dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.548491 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc469ee-1df0-4692-bdab-6d6fa19f4dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.549110 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc469ee-1df0-4692-bdab-6d6fa19f4dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:53.549405 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc469ee-1df0-4692-bdab-6d6fa19f4dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.550784 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc469ee-1df0-4692-bdab-6d6fa19f4dc3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-da278578-fcf9-442a-ba10-4c239d55f365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:53.555274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:53.556347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:53.557369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:53.557369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:53.557369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:53.558809 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 291/559] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:53.559803 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da278578-fcf9-442a-ba10-4c239d55f365 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.566695 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 269/560] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:53.566695 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc469ee-1df0-4692-bdab-6d6fa19f4dc3 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.655003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:53.663390 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da278578-fcf9-442a-ba10-4c239d55f365 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.669175 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc469ee-1df0-4692-bdab-6d6fa19f4dc3 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.701586 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f76fd6-7f40-4b27-bf8e-e8ad3225a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.702127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f76fd6-7f40-4b27-bf8e-e8ad3225a3fd None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.702414 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f76fd6-7f40-4b27-bf8e-e8ad3225a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.702702 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f76fd6-7f40-4b27-bf8e-e8ad3225a3fd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.703525 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82717592-4476-4cde-875f-d68377b05792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.704139 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717592-4476-4cde-875f-d68377b05792 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.704407 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717592-4476-4cde-875f-d68377b05792 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.704683 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717592-4476-4cde-875f-d68377b05792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.710183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f76fd6-7f40-4b27-bf8e-e8ad3225a3fd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.711658 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f76fd6-7f40-4b27-bf8e-e8ad3225a3fd None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.714871 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82717592-4476-4cde-875f-d68377b05792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.716286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82717592-4476-4cde-875f-d68377b05792 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-33f76fd6-7f40-4b27-bf8e-e8ad3225a3fd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:53.722821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:53.723917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 292/561] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:53.725075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f76fd6-7f40-4b27-bf8e-e8ad3225a3fd None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-82717592-4476-4cde-875f-d68377b05792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:53.735382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:53.736551 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:53.738062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:53.738062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:53.738062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:53.738062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 270/562] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:53.738062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82717592-4476-4cde-875f-d68377b05792 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.759753 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:53.834385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f76fd6-7f40-4b27-bf8e-e8ad3225a3fd None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.841122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82717592-4476-4cde-875f-d68377b05792 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:53.869144 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40908d-8b34-4873-adf5-f74aac179038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.869740 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40908d-8b34-4873-adf5-f74aac179038 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.870024 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40908d-8b34-4873-adf5-f74aac179038 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.870302 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40908d-8b34-4873-adf5-f74aac179038 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.871021 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40908d-8b34-4873-adf5-f74aac179038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:53.871333 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40908d-8b34-4873-adf5-f74aac179038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.872938 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40908d-8b34-4873-adf5-f74aac179038 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.875913 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b732ac8-e89a-4736-aa51-f50d6d50c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:53.876529 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b732ac8-e89a-4736-aa51-f50d6d50c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:53.876805 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b732ac8-e89a-4736-aa51-f50d6d50c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:53.877076 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b732ac8-e89a-4736-aa51-f50d6d50c1a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:53.884125 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b732ac8-e89a-4736-aa51-f50d6d50c1a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:53.885143 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 293/563] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:53.885541 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b732ac8-e89a-4736-aa51-f50d6d50c1a2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:53.885945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40908d-8b34-4873-adf5-f74aac179038 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-7b732ac8-e89a-4736-aa51-f50d6d50c1a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:15:53.900072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:53.901197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:53.902292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:15:53.902292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:15:53.902292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:15:53.902292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:15:53.902292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:15:53.902292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:15:53.902292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:53.902292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:53.902292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 271/564] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:53.902292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b732ac8-e89a-4736-aa51-f50d6d50c1a2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:53.905121 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:53.976020 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:53.987239 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40908d-8b34-4873-adf5-f74aac179038 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.002464 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b732ac8-e89a-4736-aa51-f50d6d50c1a2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.020891 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56279-7d9b-4bd6-926b-64a0d983f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.021489 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56279-7d9b-4bd6-926b-64a0d983f068 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.022437 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56279-7d9b-4bd6-926b-64a0d983f068 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.022738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56279-7d9b-4bd6-926b-64a0d983f068 None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.023464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c56279-7d9b-4bd6-926b-64a0d983f068 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:54.023767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c56279-7d9b-4bd6-926b-64a0d983f068 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.025175 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c56279-7d9b-4bd6-926b-64a0d983f068 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.036279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1441c6-8088-468d-8b07-04edee405ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.036871 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1441c6-8088-468d-8b07-04edee405ee4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.037338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1441c6-8088-468d-8b07-04edee405ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.037808 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1441c6-8088-468d-8b07-04edee405ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.038455 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1441c6-8088-468d-8b07-04edee405ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:54.038789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1441c6-8088-468d-8b07-04edee405ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.040125 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1441c6-8088-468d-8b07-04edee405ee4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.041952 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 294/565] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:54.042779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56279-7d9b-4bd6-926b-64a0d983f068 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.056318 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 272/566] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:54.056318 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1441c6-8088-468d-8b07-04edee405ee4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.114841 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:54.142322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56279-7d9b-4bd6-926b-64a0d983f068 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.155285 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1441c6-8088-468d-8b07-04edee405ee4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.176238 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9e0b-3511-4aa5-a2e8-5db2eb8e4c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.176855 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9e0b-3511-4aa5-a2e8-5db2eb8e4c70 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.177133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9e0b-3511-4aa5-a2e8-5db2eb8e4c70 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.177403 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9e0b-3511-4aa5-a2e8-5db2eb8e4c70 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.184278 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9e0b-3511-4aa5-a2e8-5db2eb8e4c70 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.185779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9e0b-3511-4aa5-a2e8-5db2eb8e4c70 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.188984 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1abbb0-ad82-4697-84e5-1695200185d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.189581 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1abbb0-ad82-4697-84e5-1695200185d6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.189864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1abbb0-ad82-4697-84e5-1695200185d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.190139 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1abbb0-ad82-4697-84e5-1695200185d6 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.190858 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1abbb0-ad82-4697-84e5-1695200185d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:54.191200 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1abbb0-ad82-4697-84e5-1695200185d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.192623 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1abbb0-ad82-4697-84e5-1695200185d6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-94bc9e0b-3511-4aa5-a2e8-5db2eb8e4c70 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:54.197399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:54.198462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:54.199458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 295/567] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:54.200042 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9e0b-3511-4aa5-a2e8-5db2eb8e4c70 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.206377 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 273/568] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:54.207227 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1abbb0-ad82-4697-84e5-1695200185d6 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.214584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:54.304987 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1abbb0-ad82-4697-84e5-1695200185d6 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.305541 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9e0b-3511-4aa5-a2e8-5db2eb8e4c70 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.327629 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:54.338914 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c487503-a886-4474-9c11-6dbd0b6c3cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.342728 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad1a58-805b-469b-94cf-519289785a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.342856 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487503-a886-4474-9c11-6dbd0b6c3cc7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.342950 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad1a58-805b-469b-94cf-519289785a74 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.343051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487503-a886-4474-9c11-6dbd0b6c3cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.343149 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad1a58-805b-469b-94cf-519289785a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.343236 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487503-a886-4474-9c11-6dbd0b6c3cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.343327 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad1a58-805b-469b-94cf-519289785a74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.347716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad1a58-805b-469b-94cf-519289785a74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.349582 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad1a58-805b-469b-94cf-519289785a74 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.350446 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c487503-a886-4474-9c11-6dbd0b6c3cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.351916 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c487503-a886-4474-9c11-6dbd0b6c3cc7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-e4ad1a58-805b-469b-94cf-519289785a74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:15:54.360939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:54.361862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:54.363118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:15:54.363118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:15:54.363118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:15:54.363118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:15:54.363118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:15:54.363118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:15:54.363118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:54.363118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:54.363118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 274/569] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:54.363832 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad1a58-805b-469b-94cf-519289785a74 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-3c487503-a886-4474-9c11-6dbd0b6c3cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:54.366591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:54.372717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:54.374133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:54.374133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:54.374133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:54.374133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 296/570] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:54.374133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c487503-a886-4474-9c11-6dbd0b6c3cc7 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.427101 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:54.469137 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c487503-a886-4474-9c11-6dbd0b6c3cc7 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.470454 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad1a58-805b-469b-94cf-519289785a74 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.503073 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f6d63-a563-400d-a19f-e10543461e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.503722 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f6d63-a563-400d-a19f-e10543461e9d None admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.504005 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f6d63-a563-400d-a19f-e10543461e9d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.504128 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5653867-8c6c-499b-b4e1-1285d5b1be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.504281 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f6d63-a563-400d-a19f-e10543461e9d None admin] PATH_INFO: `/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/685c28640ca84d2b8e85d47e64430cc0/roles/762ed046c04e4a16ade8c5e989710fa2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.504627 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5653867-8c6c-499b-b4e1-1285d5b1be4a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.504904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5653867-8c6c-499b-b4e1-1285d5b1be4a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.505172 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5653867-8c6c-499b-b4e1-1285d5b1be4a None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.505928 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5653867-8c6c-499b-b4e1-1285d5b1be4a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:54.506910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5653867-8c6c-499b-b4e1-1285d5b1be4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.508505 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5653867-8c6c-499b-b4e1-1285d5b1be4a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.520302 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f6d63-a563-400d-a19f-e10543461e9d None admin] RBAC: Authorizing `identity:create_grant(project_id=a930d08c2f31471bbe6a66f5c626d22f, user_id=685c28640ca84d2b8e85d47e64430cc0, role_id=762ed046c04e4a16ade8c5e989710fa2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.521847 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f6d63-a563-400d-a19f-e10543461e9d None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.526603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 275/571] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Aug 11 18:15:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:54.527458 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5653867-8c6c-499b-b4e1-1285d5b1be4a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.567184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:54.595171 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 297/572] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:15:54 2022] PUT /identity/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/685c28640ca84d2b8e85d47e64430cc0/roles/762ed046c04e4a16ade8c5e989710fa2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:54.596168 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f6d63-a563-400d-a19f-e10543461e9d None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.629144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5653867-8c6c-499b-b4e1-1285d5b1be4a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.674003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651704-5544-411a-a103-7d2d58422c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.675342 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651704-5544-411a-a103-7d2d58422c61 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.675664 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651704-5544-411a-a103-7d2d58422c61 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.675947 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651704-5544-411a-a103-7d2d58422c61 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.676680 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31651704-5544-411a-a103-7d2d58422c61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:54.676990 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31651704-5544-411a-a103-7d2d58422c61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.679160 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31651704-5544-411a-a103-7d2d58422c61 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.691749 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 276/573] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:54.698472 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651704-5544-411a-a103-7d2d58422c61 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.713841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f6d63-a563-400d-a19f-e10543461e9d None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.724405 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:54.758317 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681e47-8958-48d6-94a8-96c54024c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.758955 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681e47-8958-48d6-94a8-96c54024c0d0 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.759227 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681e47-8958-48d6-94a8-96c54024c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.759502 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681e47-8958-48d6-94a8-96c54024c0d0 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.760152 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43681e47-8958-48d6-94a8-96c54024c0d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:54.760455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43681e47-8958-48d6-94a8-96c54024c0d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.761849 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43681e47-8958-48d6-94a8-96c54024c0d0 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.775251 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 298/574] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:54.776386 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681e47-8958-48d6-94a8-96c54024c0d0 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.816192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:54.822921 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651704-5544-411a-a103-7d2d58422c61 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.855766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50973c-3346-4c0a-a87a-499db3995d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.856403 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50973c-3346-4c0a-a87a-499db3995d53 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.856685 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50973c-3346-4c0a-a87a-499db3995d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.857006 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50973c-3346-4c0a-a87a-499db3995d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.868037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50973c-3346-4c0a-a87a-499db3995d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.869499 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50973c-3346-4c0a-a87a-499db3995d53 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.885880 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681e47-8958-48d6-94a8-96c54024c0d0 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-3e50973c-3346-4c0a-a87a-499db3995d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:54.887611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:54.888520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:54.889450 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:54.889450 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:54.889450 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:54.889450 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 277/575] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:54.889683 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50973c-3346-4c0a-a87a-499db3995d53 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:54.927933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d41515-613c-4b43-ba8a-3e4a05ccfb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:54.928768 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d41515-613c-4b43-ba8a-3e4a05ccfb55 None admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:54.929060 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d41515-613c-4b43-ba8a-3e4a05ccfb55 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:54.929405 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d41515-613c-4b43-ba8a-3e4a05ccfb55 None admin] PATH_INFO: `/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/cc7c47252a3e4bc4b592475797aa202a/roles/762ed046c04e4a16ade8c5e989710fa2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:54.945299 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d41515-613c-4b43-ba8a-3e4a05ccfb55 None admin] RBAC: Authorizing `identity:create_grant(project_id=a930d08c2f31471bbe6a66f5c626d22f, user_id=cc7c47252a3e4bc4b592475797aa202a, role_id=762ed046c04e4a16ade8c5e989710fa2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:54.946802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d41515-613c-4b43-ba8a-3e4a05ccfb55 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:54.998199 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50973c-3346-4c0a-a87a-499db3995d53 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:55.011779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 299/576] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:15:54 2022] PUT /identity/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/cc7c47252a3e4bc4b592475797aa202a/roles/762ed046c04e4a16ade8c5e989710fa2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:15:55.012620 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d41515-613c-4b43-ba8a-3e4a05ccfb55 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:55.045471 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:55.046915 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d54ca5-d508-4e6e-82dd-23e0d8655d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:55.047731 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d54ca5-d508-4e6e-82dd-23e0d8655d78 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:55.048203 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d54ca5-d508-4e6e-82dd-23e0d8655d78 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:55.048487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d54ca5-d508-4e6e-82dd-23e0d8655d78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:55.059596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d54ca5-d508-4e6e-82dd-23e0d8655d78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:55.061406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d54ca5-d508-4e6e-82dd-23e0d8655d78 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-d5d54ca5-d508-4e6e-82dd-23e0d8655d78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:15:55.078359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:55.079537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:55.080833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:15:55.080833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:15:55.080833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:15:55.080833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:15:55.080833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:15:55.080833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:15:55.080833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:55.080833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:55.080833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 278/577] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:55.087682 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d54ca5-d508-4e6e-82dd-23e0d8655d78 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:55.111077 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:55.160025 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d41515-613c-4b43-ba8a-3e4a05ccfb55 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:55.202352 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954f4c2-9865-4c01-819b-6e71b5a81815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:55.202759 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954f4c2-9865-4c01-819b-6e71b5a81815 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:55.203043 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954f4c2-9865-4c01-819b-6e71b5a81815 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:55.203318 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954f4c2-9865-4c01-819b-6e71b5a81815 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:55.204562 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954f4c2-9865-4c01-819b-6e71b5a81815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:55.204943 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954f4c2-9865-4c01-819b-6e71b5a81815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:55.206376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954f4c2-9865-4c01-819b-6e71b5a81815 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:55.220870 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 300/578] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:55.225192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d54ca5-d508-4e6e-82dd-23e0d8655d78 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:55.226410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954f4c2-9865-4c01-819b-6e71b5a81815 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:55.271289 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725430bb-fa24-4edd-b9f4-d47684cb2985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:55.272282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725430bb-fa24-4edd-b9f4-d47684cb2985 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:55.272751 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725430bb-fa24-4edd-b9f4-d47684cb2985 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:55.273210 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725430bb-fa24-4edd-b9f4-d47684cb2985 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:55.274137 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725430bb-fa24-4edd-b9f4-d47684cb2985 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:55.274540 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725430bb-fa24-4edd-b9f4-d47684cb2985 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:55.276057 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725430bb-fa24-4edd-b9f4-d47684cb2985 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:55.292224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 279/579] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:55.294506 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725430bb-fa24-4edd-b9f4-d47684cb2985 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:55.327113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:55.349187 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954f4c2-9865-4c01-819b-6e71b5a81815 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:55.385949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc259d7-3fa3-4f3d-be8c-daec3cdda9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:55.386853 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc259d7-3fa3-4f3d-be8c-daec3cdda9b3 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:55.387282 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc259d7-3fa3-4f3d-be8c-daec3cdda9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:55.387701 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc259d7-3fa3-4f3d-be8c-daec3cdda9b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:55.390874 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:55.395864 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc259d7-3fa3-4f3d-be8c-daec3cdda9b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:55.398148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc259d7-3fa3-4f3d-be8c-daec3cdda9b3 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-cfc259d7-3fa3-4f3d-be8c-daec3cdda9b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:15:55.410108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:55.411220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:55.412424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:15:55.412424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:15:55.412424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:15:55.412424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:15:55.412424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:15:55.412424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:15:55.412424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:55.412424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:55.414455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 301/580] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:55.420321 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc259d7-3fa3-4f3d-be8c-daec3cdda9b3 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:55.430337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725430bb-fa24-4edd-b9f4-d47684cb2985 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:55.477967 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26215a-0523-47a1-9dfc-48a0d6a42880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:55.478755 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26215a-0523-47a1-9dfc-48a0d6a42880 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:55.479114 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26215a-0523-47a1-9dfc-48a0d6a42880 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:55.479638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26215a-0523-47a1-9dfc-48a0d6a42880 None admin] PATH_INFO: `/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/8f3f1554e540472ca6e38f65a1401d59/roles/762ed046c04e4a16ade8c5e989710fa2` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:55.499471 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26215a-0523-47a1-9dfc-48a0d6a42880 None admin] RBAC: Authorizing `identity:create_grant(project_id=a930d08c2f31471bbe6a66f5c626d22f, user_id=8f3f1554e540472ca6e38f65a1401d59, role_id=762ed046c04e4a16ade8c5e989710fa2)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:55.501679 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26215a-0523-47a1-9dfc-48a0d6a42880 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:55.536247 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc259d7-3fa3-4f3d-be8c-daec3cdda9b3 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:55.571294 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89819-8cbf-4ec9-b1df-8c7892af0144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:55.571897 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89819-8cbf-4ec9-b1df-8c7892af0144 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:55.572180 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89819-8cbf-4ec9-b1df-8c7892af0144 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:55.572451 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89819-8cbf-4ec9-b1df-8c7892af0144 None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:55.573128 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89819-8cbf-4ec9-b1df-8c7892af0144 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:55.573434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89819-8cbf-4ec9-b1df-8c7892af0144 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:55.575493 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89819-8cbf-4ec9-b1df-8c7892af0144 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:55.582160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:55.591078 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 302/581] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:15:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:15:55.593028 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89819-8cbf-4ec9-b1df-8c7892af0144 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:55.638791 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 280/582] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:15:55 2022] PUT /identity/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/8f3f1554e540472ca6e38f65a1401d59/roles/762ed046c04e4a16ade8c5e989710fa2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 18:15:55.719012 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89819-8cbf-4ec9-b1df-8c7892af0144 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:55.762022 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea6575-c285-4adc-9a58-5ae6f6f149b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:55.762721 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea6575-c285-4adc-9a58-5ae6f6f149b5 None admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:55.763010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea6575-c285-4adc-9a58-5ae6f6f149b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:55.763286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea6575-c285-4adc-9a58-5ae6f6f149b5 None admin] PATH_INFO: `/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/55256cb1c7f743ffa544dbd388103ab2/roles/762ed046c04e4a16ade8c5e989710fa2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:55.780312 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea6575-c285-4adc-9a58-5ae6f6f149b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a930d08c2f31471bbe6a66f5c626d22f, user_id=55256cb1c7f743ffa544dbd388103ab2, role_id=762ed046c04e4a16ade8c5e989710fa2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:55.781828 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea6575-c285-4adc-9a58-5ae6f6f149b5 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:55.876274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 303/583] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:15:55 2022] PUT /identity/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/55256cb1c7f743ffa544dbd388103ab2/roles/762ed046c04e4a16ade8c5e989710fa2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 18:15:56.840677 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64250547-be6b-4a99-8027-767e16af95af None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:56.841192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64250547-be6b-4a99-8027-767e16af95af None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:56.841192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64250547-be6b-4a99-8027-767e16af95af None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:56.842844 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 281/584] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:56.848150 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeb5f2-c1e3-4a7a-bac9-ab18090fec2a None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:56.848568 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeb5f2-c1e3-4a7a-bac9-ab18090fec2a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:56.848748 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeb5f2-c1e3-4a7a-bac9-ab18090fec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:56.867204 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-85aeb5f2-c1e3-4a7a-bac9-ab18090fec2a None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:56.868385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-85aeb5f2-c1e3-4a7a-bac9-ab18090fec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:56.915092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:56.941158 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 304/585] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:57.274648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64250547-be6b-4a99-8027-767e16af95af None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:57.339305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6926f7-ed21-401e-9467-2d328eb4e238 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:57.339596 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6926f7-ed21-401e-9467-2d328eb4e238 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:57.339877 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6926f7-ed21-401e-9467-2d328eb4e238 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:57.342809 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 305/586] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:57.347152 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae587-6326-47a2-a936-958b441f3621 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:57.347440 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae587-6326-47a2-a936-958b441f3621 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:57.347719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae587-6326-47a2-a936-958b441f3621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:57.369088 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-2f3ae587-6326-47a2-a936-958b441f3621 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:57.370839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-2f3ae587-6326-47a2-a936-958b441f3621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:57.395090 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64250547-be6b-4a99-8027-767e16af95af None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:57.424083 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:57.436786 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485a1cc-30c4-4bfb-a4f6-64c623e323f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:57.437546 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485a1cc-30c4-4bfb-a4f6-64c623e323f1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:57.437731 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485a1cc-30c4-4bfb-a4f6-64c623e323f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:57.437960 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485a1cc-30c4-4bfb-a4f6-64c623e323f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:57.450619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485a1cc-30c4-4bfb-a4f6-64c623e323f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-1485a1cc-30c4-4bfb-a4f6-64c623e323f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:57.458775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:57.459976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:57.460854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:57.463735 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 282/587] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:57.471737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485a1cc-30c4-4bfb-a4f6-64c623e323f1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:57.476411 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 306/588] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:57.585578 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485a1cc-30c4-4bfb-a4f6-64c623e323f1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:57.623764 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8738e07-3487-4267-a562-fee1cd96d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:57.624909 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8738e07-3487-4267-a562-fee1cd96d157 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:57.625397 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8738e07-3487-4267-a562-fee1cd96d157 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:57.625874 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8738e07-3487-4267-a562-fee1cd96d157 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:57.626785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8738e07-3487-4267-a562-fee1cd96d157 None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:57.627315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8738e07-3487-4267-a562-fee1cd96d157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:57.628895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8738e07-3487-4267-a562-fee1cd96d157 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:57.637962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 283/589] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:57.643254 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae587-6326-47a2-a936-958b441f3621 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:57.746311 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae587-6326-47a2-a936-958b441f3621 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:57.756864 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:57.782749 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554034f-abaa-44b8-b642-bfc0a71a369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:57.783383 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554034f-abaa-44b8-b642-bfc0a71a369b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:57.783661 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554034f-abaa-44b8-b642-bfc0a71a369b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:57.783933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554034f-abaa-44b8-b642-bfc0a71a369b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:57.794495 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554034f-abaa-44b8-b642-bfc0a71a369b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:57.796039 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554034f-abaa-44b8-b642-bfc0a71a369b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-d554034f-abaa-44b8-b642-bfc0a71a369b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:57.812368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:57.813400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:57.815040 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:57.815040 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:57.815040 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:57.815040 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 307/590] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:57.825294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8738e07-3487-4267-a562-fee1cd96d157 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:57.825376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554034f-abaa-44b8-b642-bfc0a71a369b None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:57.884544 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:57.932008 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554034f-abaa-44b8-b642-bfc0a71a369b None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:57.950358 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8738e07-3487-4267-a562-fee1cd96d157 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:57.972484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f16de-58c1-414a-a6a0-e1416b9f92c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:57.973434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f16de-58c1-414a-a6a0-e1416b9f92c9 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:57.973568 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f16de-58c1-414a-a6a0-e1416b9f92c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:57.973747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f16de-58c1-414a-a6a0-e1416b9f92c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:57.984889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f16de-58c1-414a-a6a0-e1416b9f92c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:57.989065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa0efa-045a-481a-b060-a1499dc92d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:57.990454 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa0efa-045a-481a-b060-a1499dc92d8e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:57.991128 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa0efa-045a-481a-b060-a1499dc92d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-a48f16de-58c1-414a-a6a0-e1416b9f92c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:57.991266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:57.992174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:57.993256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 308/591] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:57.994767 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa0efa-045a-481a-b060-a1499dc92d8e None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:57.995623 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa0efa-045a-481a-b060-a1499dc92d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:57.996097 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa0efa-045a-481a-b060-a1499dc92d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:57.998009 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa0efa-045a-481a-b060-a1499dc92d8e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:58.003787 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f16de-58c1-414a-a6a0-e1416b9f92c9 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:58.013666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 284/592] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:58.015194 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1eec0-098c-45a2-825b-830172929e69 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.015586 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1eec0-098c-45a2-825b-830172929e69 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.015968 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1eec0-098c-45a2-825b-830172929e69 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.022155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 285/593] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:58.022155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1eec0-098c-45a2-825b-830172929e69 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:58.034114 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:58.118004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f16de-58c1-414a-a6a0-e1416b9f92c9 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:58.134513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1eec0-098c-45a2-825b-830172929e69 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:58.136906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:58.155165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8bc8e-eed0-4734-a7e6-21ecdac4c8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:58.155774 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8bc8e-eed0-4734-a7e6-21ecdac4c8ea None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.156057 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8bc8e-eed0-4734-a7e6-21ecdac4c8ea None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.156347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8bc8e-eed0-4734-a7e6-21ecdac4c8ea None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.157566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8bc8e-eed0-4734-a7e6-21ecdac4c8ea None admin] RBAC: Adding query filter params (name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:58.158031 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8bc8e-eed0-4734-a7e6-21ecdac4c8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:58.159422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8bc8e-eed0-4734-a7e6-21ecdac4c8ea None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:58.168365 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 309/594] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:58.169721 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7ec98-44bb-4754-aab4-1b2db482b9d6 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.170010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7ec98-44bb-4754-aab4-1b2db482b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.170294 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7ec98-44bb-4754-aab4-1b2db482b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.172099 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155a4dc-6302-4939-a65f-baf24c2de498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:58.172720 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155a4dc-6302-4939-a65f-baf24c2de498 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.173002 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155a4dc-6302-4939-a65f-baf24c2de498 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.173270 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155a4dc-6302-4939-a65f-baf24c2de498 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.180804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155a4dc-6302-4939-a65f-baf24c2de498 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:58.182236 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155a4dc-6302-4939-a65f-baf24c2de498 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:58.188422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-76b7ec98-44bb-4754-aab4-1b2db482b9d6 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:58.189596 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-76b7ec98-44bb-4754-aab4-1b2db482b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-f155a4dc-6302-4939-a65f-baf24c2de498 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:58.193694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:58.194640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:58.195658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 286/595] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:15:58.196304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d558680-a0b8-41b4-9052-a187f9047a5b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.196407 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d558680-a0b8-41b4-9052-a187f9047a5b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.196681 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d558680-a0b8-41b4-9052-a187f9047a5b None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.197887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 287/596] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:15:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:15:58.198637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d558680-a0b8-41b4-9052-a187f9047a5b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:58.262134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 310/597] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:58.263009 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7ec98-44bb-4754-aab4-1b2db482b9d6 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:58.280570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:58.303851 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d558680-a0b8-41b4-9052-a187f9047a5b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:58.339359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72aa27-d669-4f99-a05a-c87aa0a803f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:58.340194 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72aa27-d669-4f99-a05a-c87aa0a803f4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.340620 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72aa27-d669-4f99-a05a-c87aa0a803f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.341065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72aa27-d669-4f99-a05a-c87aa0a803f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.352063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72aa27-d669-4f99-a05a-c87aa0a803f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:58.353685 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72aa27-d669-4f99-a05a-c87aa0a803f4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-9a72aa27-d669-4f99-a05a-c87aa0a803f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:58.367644 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:58.368787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:58.369891 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:58.369891 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:58.369891 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:58.373550 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 288/598] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:58.374823 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a40b4-a022-4ccf-870b-d00eef77e218 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.375115 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a40b4-a022-4ccf-870b-d00eef77e218 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.375393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a40b4-a022-4ccf-870b-d00eef77e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.376414 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7ec98-44bb-4754-aab4-1b2db482b9d6 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:58.395505 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6d5a40b4-a022-4ccf-870b-d00eef77e218 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:15:58.397161 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6d5a40b4-a022-4ccf-870b-d00eef77e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:15:58.408674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:58.415066 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fbfe2-412c-4182-b531-983b9d5866bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:58.415671 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fbfe2-412c-4182-b531-983b9d5866bb None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.415950 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fbfe2-412c-4182-b531-983b9d5866bb None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.416223 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fbfe2-412c-4182-b531-983b9d5866bb None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.416951 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fbfe2-412c-4182-b531-983b9d5866bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:58.417314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fbfe2-412c-4182-b531-983b9d5866bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:58.418809 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fbfe2-412c-4182-b531-983b9d5866bb None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:58.437885 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 311/599] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:58.438745 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fbfe2-412c-4182-b531-983b9d5866bb None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:58.469621 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 289/600] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:15:58.470285 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a40b4-a022-4ccf-870b-d00eef77e218 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:58.514273 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:58.548772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fbfe2-412c-4182-b531-983b9d5866bb None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:58.585804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe760d1-e2a4-40a4-ba76-87c6c1b8bfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:58.586756 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe760d1-e2a4-40a4-ba76-87c6c1b8bfb2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.587211 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe760d1-e2a4-40a4-ba76-87c6c1b8bfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.587676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe760d1-e2a4-40a4-ba76-87c6c1b8bfb2 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.588510 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe760d1-e2a4-40a4-ba76-87c6c1b8bfb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:58.589010 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe760d1-e2a4-40a4-ba76-87c6c1b8bfb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:58.590634 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe760d1-e2a4-40a4-ba76-87c6c1b8bfb2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:58.603601 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 312/601] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:58.604439 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe760d1-e2a4-40a4-ba76-87c6c1b8bfb2 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:58.614958 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a40b4-a022-4ccf-870b-d00eef77e218 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:58.652989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057394db-e460-45fe-a5ed-55d1b73a421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:58.653509 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057394db-e460-45fe-a5ed-55d1b73a421a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.653788 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057394db-e460-45fe-a5ed-55d1b73a421a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.654059 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057394db-e460-45fe-a5ed-55d1b73a421a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.670396 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:58.716519 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe760d1-e2a4-40a4-ba76-87c6c1b8bfb2 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:58.724579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057394db-e460-45fe-a5ed-55d1b73a421a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:58.726534 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057394db-e460-45fe-a5ed-55d1b73a421a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:58.753229 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:58.759664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374d158-3c06-438c-93fe-2568954aa0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:58.764548 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374d158-3c06-438c-93fe-2568954aa0a0 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.764548 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374d158-3c06-438c-93fe-2568954aa0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.764548 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374d158-3c06-438c-93fe-2568954aa0a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.772106 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374d158-3c06-438c-93fe-2568954aa0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-0374d158-3c06-438c-93fe-2568954aa0a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:58.776873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:58.777939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:58.778831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 313/602] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:58.779522 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374d158-3c06-438c-93fe-2568954aa0a0 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:58.846468 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 290/603] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:58.847368 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057394db-e460-45fe-a5ed-55d1b73a421a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:58.884654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374d158-3c06-438c-93fe-2568954aa0a0 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:58.895011 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:58.917179 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0b1ea-9328-46cf-ad73-ee064cca9057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:58.917736 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0b1ea-9328-46cf-ad73-ee064cca9057 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.918019 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0b1ea-9328-46cf-ad73-ee064cca9057 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.918293 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0b1ea-9328-46cf-ad73-ee064cca9057 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.925656 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0b1ea-9328-46cf-ad73-ee064cca9057 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:58.927131 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0b1ea-9328-46cf-ad73-ee064cca9057 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-d9c0b1ea-9328-46cf-ad73-ee064cca9057 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:58.938819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:58.940199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 314/604] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:58.941322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0b1ea-9328-46cf-ad73-ee064cca9057 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:58.952027 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057394db-e460-45fe-a5ed-55d1b73a421a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:58.986636 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61a7b-e660-489c-ab0b-bca10fe42386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:58.987265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61a7b-e660-489c-ab0b-bca10fe42386 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:58.987572 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61a7b-e660-489c-ab0b-bca10fe42386 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:58.987850 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61a7b-e660-489c-ab0b-bca10fe42386 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:58.988504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61a7b-e660-489c-ab0b-bca10fe42386 None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:58.988809 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61a7b-e660-489c-ab0b-bca10fe42386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:58.990227 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61a7b-e660-489c-ab0b-bca10fe42386 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:58.992678 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:58.999036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 291/605] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:59.000018 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61a7b-e660-489c-ab0b-bca10fe42386 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.044382 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0b1ea-9328-46cf-ad73-ee064cca9057 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.078125 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fa2d2-c3ee-41df-8a68-fc9ddd351c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.078759 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fa2d2-c3ee-41df-8a68-fc9ddd351c7f None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.079035 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fa2d2-c3ee-41df-8a68-fc9ddd351c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.079310 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fa2d2-c3ee-41df-8a68-fc9ddd351c7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.089897 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fa2d2-c3ee-41df-8a68-fc9ddd351c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-fe9fa2d2-c3ee-41df-8a68-fc9ddd351c7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:15:59.094995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:59.095949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 315/606] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:59.099959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fa2d2-c3ee-41df-8a68-fc9ddd351c7f None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.100719 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61a7b-e660-489c-ab0b-bca10fe42386 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.108920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:59.133798 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1846-aa62-4f93-bb53-6d414b045484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.134415 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1846-aa62-4f93-bb53-6d414b045484 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.134716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1846-aa62-4f93-bb53-6d414b045484 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.134987 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1846-aa62-4f93-bb53-6d414b045484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.145594 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d1846-aa62-4f93-bb53-6d414b045484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:59.147972 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d1846-aa62-4f93-bb53-6d414b045484 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-ce9d1846-aa62-4f93-bb53-6d414b045484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:59.161806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:59.162910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:59.163816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:59.163816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:59.163816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:59.163816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 292/607] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:59.164048 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1846-aa62-4f93-bb53-6d414b045484 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.199927 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fa2d2-c3ee-41df-8a68-fc9ddd351c7f None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.210858 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:59.232914 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abb229-8f43-4d9b-831a-d53a2d55bd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.234830 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb229-8f43-4d9b-831a-d53a2d55bd37 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.234830 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb229-8f43-4d9b-831a-d53a2d55bd37 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.234830 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abb229-8f43-4d9b-831a-d53a2d55bd37 None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.234830 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abb229-8f43-4d9b-831a-d53a2d55bd37 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:59.235166 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abb229-8f43-4d9b-831a-d53a2d55bd37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:59.236415 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abb229-8f43-4d9b-831a-d53a2d55bd37 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:59.253757 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 316/608] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:59.254566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abb229-8f43-4d9b-831a-d53a2d55bd37 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.265422 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1846-aa62-4f93-bb53-6d414b045484 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.300178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de18d7-174d-4b33-bf13-daa36d2853c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.300799 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de18d7-174d-4b33-bf13-daa36d2853c1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.301078 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de18d7-174d-4b33-bf13-daa36d2853c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.301351 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de18d7-174d-4b33-bf13-daa36d2853c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.312157 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de18d7-174d-4b33-bf13-daa36d2853c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:59.313597 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de18d7-174d-4b33-bf13-daa36d2853c1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-d9de18d7-174d-4b33-bf13-daa36d2853c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:59.327333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:59.328507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:59.329691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:59.329691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:59.329691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:59.329691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 293/609] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:59.329691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de18d7-174d-4b33-bf13-daa36d2853c1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.343824 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:59.356597 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abb229-8f43-4d9b-831a-d53a2d55bd37 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.391761 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040130-fb08-4514-9d8d-133bf30a5b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.392358 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040130-fb08-4514-9d8d-133bf30a5b61 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.392639 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040130-fb08-4514-9d8d-133bf30a5b61 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.392916 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040130-fb08-4514-9d8d-133bf30a5b61 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.393574 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59040130-fb08-4514-9d8d-133bf30a5b61 None admin] RBAC: Adding query filter params (name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:59.393877 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59040130-fb08-4514-9d8d-133bf30a5b61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:59.395271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59040130-fb08-4514-9d8d-133bf30a5b61 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:59.403288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 317/610] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:59.404080 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040130-fb08-4514-9d8d-133bf30a5b61 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.434254 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:59.434841 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de18d7-174d-4b33-bf13-daa36d2853c1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.469243 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d986a4-c969-41e7-88e3-01a0db180c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.469772 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d986a4-c969-41e7-88e3-01a0db180c4e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.470047 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d986a4-c969-41e7-88e3-01a0db180c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.470314 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d986a4-c969-41e7-88e3-01a0db180c4e None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.470967 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d986a4-c969-41e7-88e3-01a0db180c4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:59.471266 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d986a4-c969-41e7-88e3-01a0db180c4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:59.472611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d986a4-c969-41e7-88e3-01a0db180c4e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:59.484547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 294/611] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:59.485344 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d986a4-c969-41e7-88e3-01a0db180c4e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.503869 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040130-fb08-4514-9d8d-133bf30a5b61 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.537517 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272d2bd-4023-4607-bafd-feca00ff060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.538074 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272d2bd-4023-4607-bafd-feca00ff060b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.538357 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272d2bd-4023-4607-bafd-feca00ff060b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.538630 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272d2bd-4023-4607-bafd-feca00ff060b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.557115 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:59.587871 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d986a4-c969-41e7-88e3-01a0db180c4e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.605647 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272d2bd-4023-4607-bafd-feca00ff060b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:59.607135 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272d2bd-4023-4607-bafd-feca00ff060b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:59.623746 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe525a5e-be54-4f4b-aad8-8b832b69e457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.624346 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe525a5e-be54-4f4b-aad8-8b832b69e457 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.624626 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe525a5e-be54-4f4b-aad8-8b832b69e457 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.624904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe525a5e-be54-4f4b-aad8-8b832b69e457 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.625536 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe525a5e-be54-4f4b-aad8-8b832b69e457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:15:59.625837 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe525a5e-be54-4f4b-aad8-8b832b69e457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:59.627229 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe525a5e-be54-4f4b-aad8-8b832b69e457 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:59.636649 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:59.639423 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 295/612] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:15:59.640225 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe525a5e-be54-4f4b-aad8-8b832b69e457 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.707506 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 318/613] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:15:59.708347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272d2bd-4023-4607-bafd-feca00ff060b None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.752571 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe525a5e-be54-4f4b-aad8-8b832b69e457 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.781515 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:59.786360 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2ec4c-dd59-4f0b-b93d-0b4f1b011bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.787612 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ec4c-dd59-4f0b-b93d-0b4f1b011bec None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.787922 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ec4c-dd59-4f0b-b93d-0b4f1b011bec None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.788191 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ec4c-dd59-4f0b-b93d-0b4f1b011bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.798296 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2ec4c-dd59-4f0b-b93d-0b4f1b011bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:59.799777 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2ec4c-dd59-4f0b-b93d-0b4f1b011bec None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:59.808742 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272d2bd-4023-4607-bafd-feca00ff060b None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-efe2ec4c-dd59-4f0b-b93d-0b4f1b011bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:15:59.815065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:59.817812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:15:59.819275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:15:59.819275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:15:59.819275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:59.819275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 296/614] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:59.819275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2ec4c-dd59-4f0b-b93d-0b4f1b011bec None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.840029 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:15:59.845760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf827e-46b0-42c1-b286-75d6a5f6e2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.846377 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf827e-46b0-42c1-b286-75d6a5f6e2df None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.846653 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf827e-46b0-42c1-b286-75d6a5f6e2df None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.846948 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf827e-46b0-42c1-b286-75d6a5f6e2df None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.853531 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf827e-46b0-42c1-b286-75d6a5f6e2df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:59.855050 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf827e-46b0-42c1-b286-75d6a5f6e2df None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-67cf827e-46b0-42c1-b286-75d6a5f6e2df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:15:59.865818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:59.866936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:59.867863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:15:59.867863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:15:59.867863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:15:59.867863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:15:59.867863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:15:59.867863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:15:59.867863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:15:59.867863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:15:59.867863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 319/615] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:59.868357 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf827e-46b0-42c1-b286-75d6a5f6e2df None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:15:59.927565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2ec4c-dd59-4f0b-b93d-0b4f1b011bec None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.961205 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9b0df-c11d-46ab-af71-47939dbc2001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:15:59.961833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9b0df-c11d-46ab-af71-47939dbc2001 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:15:59.962110 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9b0df-c11d-46ab-af71-47939dbc2001 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:15:59.962382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9b0df-c11d-46ab-af71-47939dbc2001 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:15:59.967131 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf827e-46b0-42c1-b286-75d6a5f6e2df None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:15:59.969640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9b0df-c11d-46ab-af71-47939dbc2001 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:15:59.971102 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9b0df-c11d-46ab-af71-47939dbc2001 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-3fe9b0df-c11d-46ab-af71-47939dbc2001 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:15:59.981981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:15:59.983129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 297/616] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:15:59.984425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9b0df-c11d-46ab-af71-47939dbc2001 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.001847 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d208fe-fec6-43cb-916c-27489cb55dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.002395 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d208fe-fec6-43cb-916c-27489cb55dd4 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.002695 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d208fe-fec6-43cb-916c-27489cb55dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.002979 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d208fe-fec6-43cb-916c-27489cb55dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.013191 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d208fe-fec6-43cb-916c-27489cb55dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.014604 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d208fe-fec6-43cb-916c-27489cb55dd4 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-61d208fe-fec6-43cb-916c-27489cb55dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:16:00.029122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:00.030248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:16:00.031267 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:16:00.031267 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:00.031267 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:00.031267 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 320/617] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:00.031267 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d208fe-fec6-43cb-916c-27489cb55dd4 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.037270 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:00.073455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:00.091625 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9b0df-c11d-46ab-af71-47939dbc2001 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.124753 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c87b91-b26f-4a60-86f2-59f029a05e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.125347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87b91-b26f-4a60-86f2-59f029a05e87 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.125627 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87b91-b26f-4a60-86f2-59f029a05e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.125898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87b91-b26f-4a60-86f2-59f029a05e87 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.126533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c87b91-b26f-4a60-86f2-59f029a05e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:00.126868 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c87b91-b26f-4a60-86f2-59f029a05e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.128231 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c87b91-b26f-4a60-86f2-59f029a05e87 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.129199 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d208fe-fec6-43cb-916c-27489cb55dd4 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.140158 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 298/618] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:00.140949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c87b91-b26f-4a60-86f2-59f029a05e87 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.163927 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02902f6-c3ab-48e3-8b2b-548e6911bdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.164526 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02902f6-c3ab-48e3-8b2b-548e6911bdc5 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.164810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02902f6-c3ab-48e3-8b2b-548e6911bdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.165089 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02902f6-c3ab-48e3-8b2b-548e6911bdc5 None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.165770 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02902f6-c3ab-48e3-8b2b-548e6911bdc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:00.166079 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02902f6-c3ab-48e3-8b2b-548e6911bdc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.167583 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02902f6-c3ab-48e3-8b2b-548e6911bdc5 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.179436 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 321/619] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:00.180372 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02902f6-c3ab-48e3-8b2b-548e6911bdc5 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.238639 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c87b91-b26f-4a60-86f2-59f029a05e87 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.241427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:00.274778 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfa1b2-0230-4b06-973d-0be6f11f8018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.275314 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfa1b2-0230-4b06-973d-0be6f11f8018 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.275592 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfa1b2-0230-4b06-973d-0be6f11f8018 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.275865 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfa1b2-0230-4b06-973d-0be6f11f8018 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.276609 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfa1b2-0230-4b06-973d-0be6f11f8018 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:00.276917 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfa1b2-0230-4b06-973d-0be6f11f8018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.278340 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfa1b2-0230-4b06-973d-0be6f11f8018 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.278988 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02902f6-c3ab-48e3-8b2b-548e6911bdc5 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.280475 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:00.295207 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 299/620] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:00.296018 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfa1b2-0230-4b06-973d-0be6f11f8018 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.315051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07198f44-ee7a-4f95-b5ad-5d16c05ece4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.315643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198f44-ee7a-4f95-b5ad-5d16c05ece4b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.315918 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198f44-ee7a-4f95-b5ad-5d16c05ece4b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.316320 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198f44-ee7a-4f95-b5ad-5d16c05ece4b None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.316808 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07198f44-ee7a-4f95-b5ad-5d16c05ece4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:00.317105 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07198f44-ee7a-4f95-b5ad-5d16c05ece4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.319178 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07198f44-ee7a-4f95-b5ad-5d16c05ece4b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.330218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 322/621] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:00.331037 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07198f44-ee7a-4f95-b5ad-5d16c05ece4b None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.399296 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfa1b2-0230-4b06-973d-0be6f11f8018 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.433641 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce164dc-0df4-4491-b9f3-15c1ac7fa56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.434261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce164dc-0df4-4491-b9f3-15c1ac7fa56d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.434537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce164dc-0df4-4491-b9f3-15c1ac7fa56d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.434839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce164dc-0df4-4491-b9f3-15c1ac7fa56d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.441664 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce164dc-0df4-4491-b9f3-15c1ac7fa56d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.444163 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce164dc-0df4-4491-b9f3-15c1ac7fa56d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.451474 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07198f44-ee7a-4f95-b5ad-5d16c05ece4b None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-fce164dc-0df4-4491-b9f3-15c1ac7fa56d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:16:00.455420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:00.461307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 300/622] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:00.462579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce164dc-0df4-4491-b9f3-15c1ac7fa56d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.483312 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:00.486125 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694700a-4d91-4597-822d-c3d12bf83112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.486746 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694700a-4d91-4597-822d-c3d12bf83112 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.487023 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694700a-4d91-4597-822d-c3d12bf83112 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.487292 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694700a-4d91-4597-822d-c3d12bf83112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.487995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694700a-4d91-4597-822d-c3d12bf83112 None admin] RBAC: Adding query filter params (role.id=762ed046c04e4a16ade8c5e989710fa2, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=685c28640ca84d2b8e85d47e64430cc0) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:00.488303 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694700a-4d91-4597-822d-c3d12bf83112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.490282 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694700a-4d91-4597-822d-c3d12bf83112 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.495864 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 323/623] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/role_assignments?user.id=685c28640ca84d2b8e85d47e64430cc0&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=762ed046c04e4a16ade8c5e989710fa2 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:00.496910 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694700a-4d91-4597-822d-c3d12bf83112 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.527784 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:00.575444 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce164dc-0df4-4491-b9f3-15c1ac7fa56d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.612896 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694700a-4d91-4597-822d-c3d12bf83112 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.617202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8615521-7243-4cc1-bf0c-5062e3756d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.617892 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8615521-7243-4cc1-bf0c-5062e3756d31 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.618269 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8615521-7243-4cc1-bf0c-5062e3756d31 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.618613 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8615521-7243-4cc1-bf0c-5062e3756d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.652857 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaec06-9c6d-4ae6-8336-03f218efb25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.653611 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaec06-9c6d-4ae6-8336-03f218efb25b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.654236 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaec06-9c6d-4ae6-8336-03f218efb25b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.655080 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaec06-9c6d-4ae6-8336-03f218efb25b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.663956 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaec06-9c6d-4ae6-8336-03f218efb25b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.665626 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaec06-9c6d-4ae6-8336-03f218efb25b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-4beaec06-9c6d-4ae6-8336-03f218efb25b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:16:00.680997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:00.681959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:00.683067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:16:00.683067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:16:00.683067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:16:00.683067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:16:00.683067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:16:00.683067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:16:00.683067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:00.683067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:00.683067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 324/624] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:00.683067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaec06-9c6d-4ae6-8336-03f218efb25b None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.703001 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8615521-7243-4cc1-bf0c-5062e3756d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.704560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8615521-7243-4cc1-bf0c-5062e3756d31 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.731888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:00.801266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:00.817364 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaec06-9c6d-4ae6-8336-03f218efb25b None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.820822 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 301/625] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:16:00.821583 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8615521-7243-4cc1-bf0c-5062e3756d31 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.857250 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efcd29-738c-4c6e-89f4-3db2e5a524f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.857943 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efcd29-738c-4c6e-89f4-3db2e5a524f8 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.858299 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efcd29-738c-4c6e-89f4-3db2e5a524f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.858637 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efcd29-738c-4c6e-89f4-3db2e5a524f8 None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.859464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efcd29-738c-4c6e-89f4-3db2e5a524f8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:00.859854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efcd29-738c-4c6e-89f4-3db2e5a524f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.861353 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efcd29-738c-4c6e-89f4-3db2e5a524f8 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.882253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 325/626] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:00.883263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efcd29-738c-4c6e-89f4-3db2e5a524f8 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:00.933687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8615521-7243-4cc1-bf0c-5062e3756d31 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.959667 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:00.972254 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76bb1-1be4-41f1-b5fe-30a977dc4ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:00.972938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76bb1-1be4-41f1-b5fe-30a977dc4ccf None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:00.973272 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76bb1-1be4-41f1-b5fe-30a977dc4ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:00.973667 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76bb1-1be4-41f1-b5fe-30a977dc4ccf None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:00.974494 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76bb1-1be4-41f1-b5fe-30a977dc4ccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:00.974902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76bb1-1be4-41f1-b5fe-30a977dc4ccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:00.976506 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76bb1-1be4-41f1-b5fe-30a977dc4ccf None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:00.988476 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efcd29-738c-4c6e-89f4-3db2e5a524f8 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:00.989198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 302/627] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:00.990922 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76bb1-1be4-41f1-b5fe-30a977dc4ccf None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:01.030876 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f282f37-88dd-42c2-ac32-58cd7fd8809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:01.031500 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f282f37-88dd-42c2-ac32-58cd7fd8809a None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:01.031784 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f282f37-88dd-42c2-ac32-58cd7fd8809a None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:01.032055 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f282f37-88dd-42c2-ac32-58cd7fd8809a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:01.042009 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f282f37-88dd-42c2-ac32-58cd7fd8809a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:01.043478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f282f37-88dd-42c2-ac32-58cd7fd8809a None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:01.046004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-3f282f37-88dd-42c2-ac32-58cd7fd8809a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:16:01.065332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:01.066584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:16:01.067785 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:16:01.067785 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:01.067785 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:01.067785 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 326/628] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:01.067785 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f282f37-88dd-42c2-ac32-58cd7fd8809a None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:01.118728 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76bb1-1be4-41f1-b5fe-30a977dc4ccf None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:01.159138 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b851c0-ea06-4ec7-b189-34b22a5ccdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:01.159839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b851c0-ea06-4ec7-b189-34b22a5ccdac None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:01.160018 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b851c0-ea06-4ec7-b189-34b22a5ccdac None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:01.160293 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b851c0-ea06-4ec7-b189-34b22a5ccdac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:01.166722 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f282f37-88dd-42c2-ac32-58cd7fd8809a None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:01.202206 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3c4b5-f96a-4de5-9048-d5e74a13f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:01.202900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3c4b5-f96a-4de5-9048-d5e74a13f176 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:01.203182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3c4b5-f96a-4de5-9048-d5e74a13f176 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:01.203456 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3c4b5-f96a-4de5-9048-d5e74a13f176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:01.204167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3c4b5-f96a-4de5-9048-d5e74a13f176 None admin] RBAC: Adding query filter params (role.id=762ed046c04e4a16ade8c5e989710fa2, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=cc7c47252a3e4bc4b592475797aa202a) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:01.204477 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3c4b5-f96a-4de5-9048-d5e74a13f176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:01.205915 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3c4b5-f96a-4de5-9048-d5e74a13f176 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:01.219085 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:01.222443 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 327/629] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:16:01 2022] GET /identity/v3/role_assignments?user.id=cc7c47252a3e4bc4b592475797aa202a&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=762ed046c04e4a16ade8c5e989710fa2 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:01.223409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3c4b5-f96a-4de5-9048-d5e74a13f176 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:01.246077 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b851c0-ea06-4ec7-b189-34b22a5ccdac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:01.247819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b851c0-ea06-4ec7-b189-34b22a5ccdac None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:01.308856 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:01.381904 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3c4b5-f96a-4de5-9048-d5e74a13f176 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:01.391969 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 303/630] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:16:01.398696 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b851c0-ea06-4ec7-b189-34b22a5ccdac None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:01.449788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b373f1e-623c-4389-8cc6-bc5be89b86e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:01.450822 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b373f1e-623c-4389-8cc6-bc5be89b86e1 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:01.451301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b373f1e-623c-4389-8cc6-bc5be89b86e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:01.452384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b373f1e-623c-4389-8cc6-bc5be89b86e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:01.453230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b373f1e-623c-4389-8cc6-bc5be89b86e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:01.454195 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b373f1e-623c-4389-8cc6-bc5be89b86e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:01.456243 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b373f1e-623c-4389-8cc6-bc5be89b86e1 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:01.475583 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 328/631] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:01.481547 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b373f1e-623c-4389-8cc6-bc5be89b86e1 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:01.514300 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:01.541519 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b851c0-ea06-4ec7-b189-34b22a5ccdac None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:01.588076 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7fea6-8e9f-43bb-ae66-e8e01666615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:01.589747 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7fea6-8e9f-43bb-ae66-e8e01666615b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:01.590218 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7fea6-8e9f-43bb-ae66-e8e01666615b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:01.590717 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7fea6-8e9f-43bb-ae66-e8e01666615b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:01.603801 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7fea6-8e9f-43bb-ae66-e8e01666615b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:01.606497 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7fea6-8e9f-43bb-ae66-e8e01666615b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:01.613838 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b373f1e-623c-4389-8cc6-bc5be89b86e1 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-2ca7fea6-8e9f-43bb-ae66-e8e01666615b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:16:01.625319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:01.626356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:16:01.627645 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:16:01.627645 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:01.627645 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:01.629560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 304/632] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:01.647055 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7fea6-8e9f-43bb-ae66-e8e01666615b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:01.647257 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:01.669787 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9edc1c-e24b-42ad-8705-0f73587bc510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:01.670525 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9edc1c-e24b-42ad-8705-0f73587bc510 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:01.670885 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9edc1c-e24b-42ad-8705-0f73587bc510 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:01.671349 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9edc1c-e24b-42ad-8705-0f73587bc510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:01.695585 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9edc1c-e24b-42ad-8705-0f73587bc510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:01.697185 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9edc1c-e24b-42ad-8705-0f73587bc510 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-db9edc1c-e24b-42ad-8705-0f73587bc510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:16:01.730314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:01.731306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:01.732183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:16:01.732183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:16:01.732183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:16:01.732183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:16:01.732183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:16:01.732183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:16:01.732183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:01.732183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:01.740661 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 329/633] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:01.748950 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9edc1c-e24b-42ad-8705-0f73587bc510 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:01.773569 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7fea6-8e9f-43bb-ae66-e8e01666615b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:01.809097 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70354b33-8044-45f4-86f3-4730378aa927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:01.809736 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70354b33-8044-45f4-86f3-4730378aa927 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:01.810017 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70354b33-8044-45f4-86f3-4730378aa927 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:01.810291 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70354b33-8044-45f4-86f3-4730378aa927 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:01.811003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70354b33-8044-45f4-86f3-4730378aa927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:01.811316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70354b33-8044-45f4-86f3-4730378aa927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:01.812690 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70354b33-8044-45f4-86f3-4730378aa927 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:01.830953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 305/634] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:01.831163 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:01.833724 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70354b33-8044-45f4-86f3-4730378aa927 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:01.930145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9edc1c-e24b-42ad-8705-0f73587bc510 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:01.966226 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8119d5a-4aa8-4d27-908d-1f7bbb3627ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:01.966864 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119d5a-4aa8-4d27-908d-1f7bbb3627ff None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:01.967147 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119d5a-4aa8-4d27-908d-1f7bbb3627ff None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:01.967593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119d5a-4aa8-4d27-908d-1f7bbb3627ff None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:01.968184 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8119d5a-4aa8-4d27-908d-1f7bbb3627ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:01.968492 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8119d5a-4aa8-4d27-908d-1f7bbb3627ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:01.969934 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8119d5a-4aa8-4d27-908d-1f7bbb3627ff None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:01.972826 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70354b33-8044-45f4-86f3-4730378aa927 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:01.988022 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 330/635] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:01.989316 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8119d5a-4aa8-4d27-908d-1f7bbb3627ff None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:02.017144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43408a-14ea-4b5a-9fb7-b051f46c697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:02.017932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43408a-14ea-4b5a-9fb7-b051f46c697c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:02.018214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43408a-14ea-4b5a-9fb7-b051f46c697c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:02.018489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43408a-14ea-4b5a-9fb7-b051f46c697c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:02.026270 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43408a-14ea-4b5a-9fb7-b051f46c697c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:02.027924 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43408a-14ea-4b5a-9fb7-b051f46c697c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-cc43408a-14ea-4b5a-9fb7-b051f46c697c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:16:02.040159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:02.041116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:02.042036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:16:02.042036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:16:02.042036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:16:02.042036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:16:02.042036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:16:02.042036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:16:02.042036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:02.042036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:02.043014 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 306/636] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:02.043127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:02.048150 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43408a-14ea-4b5a-9fb7-b051f46c697c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:02.121829 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:02.122031 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8119d5a-4aa8-4d27-908d-1f7bbb3627ff None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:02.162283 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1cd5b-41b3-48ae-b266-77643d594f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:02.162929 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1cd5b-41b3-48ae-b266-77643d594f26 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:02.163216 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1cd5b-41b3-48ae-b266-77643d594f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:02.163495 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1cd5b-41b3-48ae-b266-77643d594f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:02.164223 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1cd5b-41b3-48ae-b266-77643d594f26 None admin] RBAC: Adding query filter params (role.id=762ed046c04e4a16ade8c5e989710fa2, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=8f3f1554e540472ca6e38f65a1401d59) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:02.164535 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1cd5b-41b3-48ae-b266-77643d594f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:02.166369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1cd5b-41b3-48ae-b266-77643d594f26 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:02.178691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43408a-14ea-4b5a-9fb7-b051f46c697c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:02.178911 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 331/637] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:16:01 2022] GET /identity/v3/role_assignments?user.id=8f3f1554e540472ca6e38f65a1401d59&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=762ed046c04e4a16ade8c5e989710fa2 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:02.219181 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20695816-3839-4746-81ac-81fa269fb74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:02.219722 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20695816-3839-4746-81ac-81fa269fb74f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:02.220005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20695816-3839-4746-81ac-81fa269fb74f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:02.220280 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20695816-3839-4746-81ac-81fa269fb74f None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:02.221050 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20695816-3839-4746-81ac-81fa269fb74f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:02.221365 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20695816-3839-4746-81ac-81fa269fb74f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:02.222872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20695816-3839-4746-81ac-81fa269fb74f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:02.238053 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 307/638] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:02.244558 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1cd5b-41b3-48ae-b266-77643d594f26 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:02.363998 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1cd5b-41b3-48ae-b266-77643d594f26 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:02.367928 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:02.405594 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6a1ed-cbfd-4b26-9c65-145540f55848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:02.406567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6a1ed-cbfd-4b26-9c65-145540f55848 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:02.407109 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6a1ed-cbfd-4b26-9c65-145540f55848 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:02.407582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6a1ed-cbfd-4b26-9c65-145540f55848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:02.408541 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6a1ed-cbfd-4b26-9c65-145540f55848 None admin] RBAC: Adding query filter params (role.id=762ed046c04e4a16ade8c5e989710fa2, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=55256cb1c7f743ffa544dbd388103ab2) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:02.409054 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6a1ed-cbfd-4b26-9c65-145540f55848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:02.410755 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6a1ed-cbfd-4b26-9c65-145540f55848 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:02.417385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 332/639] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:16:02 2022] GET /identity/v3/role_assignments?user.id=55256cb1c7f743ffa544dbd388103ab2&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=762ed046c04e4a16ade8c5e989710fa2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:02.859482 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216f7fd-904a-489d-a85b-69bfc2b774f0 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:02.859863 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216f7fd-904a-489d-a85b-69bfc2b774f0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:02.860066 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216f7fd-904a-489d-a85b-69bfc2b774f0 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:02.861534 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 308/640] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:02.867369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93316d50-a9db-41e4-9975-fb703e8d7917 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:02.867900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93316d50-a9db-41e4-9975-fb703e8d7917 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:02.868373 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93316d50-a9db-41e4-9975-fb703e8d7917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:02.888243 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-93316d50-a9db-41e4-9975-fb703e8d7917 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:02.889772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-93316d50-a9db-41e4-9975-fb703e8d7917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:02.962557 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 333/641] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:16:03.286269 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216f7fd-904a-489d-a85b-69bfc2b774f0 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:03.391915 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216f7fd-904a-489d-a85b-69bfc2b774f0 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:03.407985 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:03.432875 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb026879-bda9-4af8-a0c1-1f53809e0c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:03.433505 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026879-bda9-4af8-a0c1-1f53809e0c08 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:03.433783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026879-bda9-4af8-a0c1-1f53809e0c08 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:03.434055 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb026879-bda9-4af8-a0c1-1f53809e0c08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:03.445204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb026879-bda9-4af8-a0c1-1f53809e0c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-eb026879-bda9-4af8-a0c1-1f53809e0c08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:16:03.450301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:03.451326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:03.452265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 309/642] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:03.460135 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93316d50-a9db-41e4-9975-fb703e8d7917 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:03.563167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93316d50-a9db-41e4-9975-fb703e8d7917 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:03.567234 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:03.604644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd98704-612e-4a78-90f2-3e0087c6c655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:03.605274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98704-612e-4a78-90f2-3e0087c6c655 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:03.605556 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98704-612e-4a78-90f2-3e0087c6c655 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:03.605826 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98704-612e-4a78-90f2-3e0087c6c655 None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:03.606511 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd98704-612e-4a78-90f2-3e0087c6c655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:03.606849 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd98704-612e-4a78-90f2-3e0087c6c655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:03.608246 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd98704-612e-4a78-90f2-3e0087c6c655 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:03.619188 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 334/643] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:16:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:03.625124 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb026879-bda9-4af8-a0c1-1f53809e0c08 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:03.739131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb026879-bda9-4af8-a0c1-1f53809e0c08 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:03.755602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372a2b-ac64-4dcf-b4c0-8bac293d317e None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:03.756017 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372a2b-ac64-4dcf-b4c0-8bac293d317e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:03.756219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372a2b-ac64-4dcf-b4c0-8bac293d317e None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:03.758737 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 335/644] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:16:03.764194 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367d7c4-2202-493e-9753-06e23c370c53 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:03.764487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367d7c4-2202-493e-9753-06e23c370c53 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:03.764796 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367d7c4-2202-493e-9753-06e23c370c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:03.785541 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-a367d7c4-2202-493e-9753-06e23c370c53 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:03.786010 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad758b0-ebdd-448d-8da9-61ee18674dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:03.786754 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad758b0-ebdd-448d-8da9-61ee18674dfc None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:03.786860 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-a367d7c4-2202-493e-9753-06e23c370c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:03.787057 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad758b0-ebdd-448d-8da9-61ee18674dfc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:03.787338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad758b0-ebdd-448d-8da9-61ee18674dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:03.800550 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad758b0-ebdd-448d-8da9-61ee18674dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:03.803162 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad758b0-ebdd-448d-8da9-61ee18674dfc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-dad758b0-ebdd-448d-8da9-61ee18674dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:16:03.822655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:03.823828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:16:03.825116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:16:03.825116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:03.825116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:03.825116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 310/645] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:16:03.830730 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad758b0-ebdd-448d-8da9-61ee18674dfc None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:03.860768 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:03.871500 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 336/646] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:16:03.947582 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad758b0-ebdd-448d-8da9-61ee18674dfc None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:03.984242 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0da48-58b5-431c-8d84-7011cc492673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:03.984847 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0da48-58b5-431c-8d84-7011cc492673 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:03.985127 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0da48-58b5-431c-8d84-7011cc492673 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:03.985402 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0da48-58b5-431c-8d84-7011cc492673 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:03.986135 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0da48-58b5-431c-8d84-7011cc492673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:03.986445 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0da48-58b5-431c-8d84-7011cc492673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:03.987905 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0da48-58b5-431c-8d84-7011cc492673 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:04.001019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 311/647] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:04.007170 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367d7c4-2202-493e-9753-06e23c370c53 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:04.115747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367d7c4-2202-493e-9753-06e23c370c53 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:04.119881 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:04.151715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73071b-a590-4aa9-8e80-b33ada478021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:04.153302 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73071b-a590-4aa9-8e80-b33ada478021 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.153636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73071b-a590-4aa9-8e80-b33ada478021 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.154040 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73071b-a590-4aa9-8e80-b33ada478021 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.161663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73071b-a590-4aa9-8e80-b33ada478021 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:04.163140 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73071b-a590-4aa9-8e80-b33ada478021 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-ea73071b-a590-4aa9-8e80-b33ada478021 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:16:04.175676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:04.176659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:04.178165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 337/648] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 11 18:16:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:04.185101 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0da48-58b5-431c-8d84-7011cc492673 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:04.201090 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73071b-a590-4aa9-8e80-b33ada478021 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:04.294399 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:04.308830 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73071b-a590-4aa9-8e80-b33ada478021 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:04.314196 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0da48-58b5-431c-8d84-7011cc492673 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:04.347664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5977c-113f-41b3-8109-14a2df9ec892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:04.349314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5977c-113f-41b3-8109-14a2df9ec892 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.349803 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5977c-113f-41b3-8109-14a2df9ec892 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.350352 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5977c-113f-41b3-8109-14a2df9ec892 None admin] PATH_INFO: `/v3/services/image` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.351184 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5977c-113f-41b3-8109-14a2df9ec892 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:04.352864 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5977c-113f-41b3-8109-14a2df9ec892 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:04.359164 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de50a9-5392-4ebb-82d5-54bc901a3d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:04.359799 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de50a9-5392-4ebb-82d5-54bc901a3d92 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.360083 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de50a9-5392-4ebb-82d5-54bc901a3d92 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.360360 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de50a9-5392-4ebb-82d5-54bc901a3d92 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.361257 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de50a9-5392-4ebb-82d5-54bc901a3d92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:04.366489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de50a9-5392-4ebb-82d5-54bc901a3d92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:04.368019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de50a9-5392-4ebb-82d5-54bc901a3d92 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-d6a5977c-113f-41b3-8109-14a2df9ec892 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:04.368505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:04.369516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 18:16:04.370384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:04.379154 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 338/649] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Aug 11 18:16:04 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:16:04.382847 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5977c-113f-41b3-8109-14a2df9ec892 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:04.397778 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 312/650] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 11 18:16:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:04.403058 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de50a9-5392-4ebb-82d5-54bc901a3d92 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:04.403583 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:04.500248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5977c-113f-41b3-8109-14a2df9ec892 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:04.505172 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de50a9-5392-4ebb-82d5-54bc901a3d92 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:04.541285 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15500d-0f3c-4112-81b5-d3bebfda1d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:04.542141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15500d-0f3c-4112-81b5-d3bebfda1d8f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.542253 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15500d-0f3c-4112-81b5-d3bebfda1d8f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.542730 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15500d-0f3c-4112-81b5-d3bebfda1d8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.544420 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3952c-002e-4f30-97c6-2e766238ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:04.545026 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3952c-002e-4f30-97c6-2e766238ca60 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.545337 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3952c-002e-4f30-97c6-2e766238ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.545574 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3952c-002e-4f30-97c6-2e766238ca60 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.546763 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3952c-002e-4f30-97c6-2e766238ca60 None admin] RBAC: Adding query filter params (name=image) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:04.546763 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3952c-002e-4f30-97c6-2e766238ca60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:04.547912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3952c-002e-4f30-97c6-2e766238ca60 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:04.558271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 339/651] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:04.558271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a853-d430-42e8-b246-324b82faefaa None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.558271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a853-d430-42e8-b246-324b82faefaa None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.558271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a853-d430-42e8-b246-324b82faefaa None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.558271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 340/652] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:04.559706 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a853-d430-42e8-b246-324b82faefaa None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:04.563288 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:04.626542 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15500d-0f3c-4112-81b5-d3bebfda1d8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:04.628095 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15500d-0f3c-4112-81b5-d3bebfda1d8f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:04.647525 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:04.672894 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a853-d430-42e8-b246-324b82faefaa None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:04.715059 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c0d37-f4f5-4442-80d2-07b5fa232aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:04.715655 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c0d37-f4f5-4442-80d2-07b5fa232aff None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.715929 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c0d37-f4f5-4442-80d2-07b5fa232aff None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.716198 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c0d37-f4f5-4442-80d2-07b5fa232aff None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.716825 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c0d37-f4f5-4442-80d2-07b5fa232aff None admin] RBAC: Adding query filter params (type=image) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:04.717122 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c0d37-f4f5-4442-80d2-07b5fa232aff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:04.718477 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c0d37-f4f5-4442-80d2-07b5fa232aff None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:04.724094 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 341/653] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:04.725232 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e282-56b3-43af-8cc0-b803b4a64209 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.725512 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e282-56b3-43af-8cc0-b803b4a64209 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.725780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e282-56b3-43af-8cc0-b803b4a64209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.748955 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-7699e282-56b3-43af-8cc0-b803b4a64209 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:04.750400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-7699e282-56b3-43af-8cc0-b803b4a64209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:04.764161 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 313/654] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 18:16:04.767241 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15500d-0f3c-4112-81b5-d3bebfda1d8f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:04.821710 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:04.847951 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 342/655] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:16:04.849303 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced40e-b79c-4b03-97c3-31c365918d6d None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.849597 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced40e-b79c-4b03-97c3-31c365918d6d None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.849871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced40e-b79c-4b03-97c3-31c365918d6d None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.851458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 343/656] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:04.857139 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c892-31b2-4ba8-b5e8-b1e63fd6514d None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.857421 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c892-31b2-4ba8-b5e8-b1e63fd6514d None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.857694 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c892-31b2-4ba8-b5e8-b1e63fd6514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.877946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-52e8c892-31b2-4ba8-b5e8-b1e63fd6514d None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:04.879488 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-52e8c892-31b2-4ba8-b5e8-b1e63fd6514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:04.896409 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15500d-0f3c-4112-81b5-d3bebfda1d8f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:04.940603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fec3b-7427-47e7-923f-efb0308ca701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:04.941349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fec3b-7427-47e7-923f-efb0308ca701 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:04.941634 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fec3b-7427-47e7-923f-efb0308ca701 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:04.941908 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fec3b-7427-47e7-923f-efb0308ca701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:04.955019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fec3b-7427-47e7-923f-efb0308ca701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:04.956588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fec3b-7427-47e7-923f-efb0308ca701 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:04.971037 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 344/657] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-d16fec3b-7427-47e7-923f-efb0308ca701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:16:04.982038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:04.983037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:16:04.983932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:16:04.983932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:04.983932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:04.983932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 314/658] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:04.988657 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c892-31b2-4ba8-b5e8-b1e63fd6514d None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:04.991360 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:05.096683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c892-31b2-4ba8-b5e8-b1e63fd6514d None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:05.134157 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8debc-c2ff-4d79-9578-9b2a19f5879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:05.135178 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8debc-c2ff-4d79-9578-9b2a19f5879b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:05.135682 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8debc-c2ff-4d79-9578-9b2a19f5879b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:05.136152 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8debc-c2ff-4d79-9578-9b2a19f5879b None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:05.137034 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8debc-c2ff-4d79-9578-9b2a19f5879b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:05.137554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8debc-c2ff-4d79-9578-9b2a19f5879b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:05.139150 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8debc-c2ff-4d79-9578-9b2a19f5879b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:05.151957 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 345/659] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:05.157189 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fec3b-7427-47e7-923f-efb0308ca701 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:05.194875 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8debc-c2ff-4d79-9578-9b2a19f5879b None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:05.261059 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:05.267151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fec3b-7427-47e7-923f-efb0308ca701 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:05.267526 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:05.305974 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8debc-c2ff-4d79-9578-9b2a19f5879b None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:05.311215 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96871f-57de-4afb-ac1a-1bb2de275c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:05.311845 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96871f-57de-4afb-ac1a-1bb2de275c11 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:05.312123 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96871f-57de-4afb-ac1a-1bb2de275c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:05.312396 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96871f-57de-4afb-ac1a-1bb2de275c11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:05.319975 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96871f-57de-4afb-ac1a-1bb2de275c11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:05.321423 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96871f-57de-4afb-ac1a-1bb2de275c11 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-4e96871f-57de-4afb-ac1a-1bb2de275c11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:16:05.332776 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:05.334041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:05.335315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:16:05.335315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:16:05.335315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:16:05.335315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:16:05.335315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:16:05.335315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:16:05.335315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:05.335315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:05.338819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 315/660] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:05.339692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96871f-57de-4afb-ac1a-1bb2de275c11 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:05.343744 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a08c73-3545-44ec-9024-4452d6afa642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:05.344518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a08c73-3545-44ec-9024-4452d6afa642 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:05.344867 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a08c73-3545-44ec-9024-4452d6afa642 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:05.345206 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a08c73-3545-44ec-9024-4452d6afa642 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:05.345912 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a08c73-3545-44ec-9024-4452d6afa642 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:05.347392 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a08c73-3545-44ec-9024-4452d6afa642 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-15a08c73-3545-44ec-9024-4452d6afa642 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:05.358804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:05.359866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 18:16:05.360713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:05.365115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 346/661] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Aug 11 18:16:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:16:05.366279 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a08c73-3545-44ec-9024-4452d6afa642 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:05.451544 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96871f-57de-4afb-ac1a-1bb2de275c11 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:05.477880 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a08c73-3545-44ec-9024-4452d6afa642 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:05.487261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701b44a-ac20-470c-9fc4-252504cddada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:05.487856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701b44a-ac20-470c-9fc4-252504cddada None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:05.488247 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701b44a-ac20-470c-9fc4-252504cddada None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:05.488515 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701b44a-ac20-470c-9fc4-252504cddada None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:05.489190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701b44a-ac20-470c-9fc4-252504cddada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:05.490016 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701b44a-ac20-470c-9fc4-252504cddada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:05.491482 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701b44a-ac20-470c-9fc4-252504cddada None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:05.503023 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 316/662] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:16:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:05.503942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:05.507830 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701b44a-ac20-470c-9fc4-252504cddada None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:05.514370 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5131467-e0df-4968-b7e5-ca5e88ff09cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:05.515076 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5131467-e0df-4968-b7e5-ca5e88ff09cf None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:05.515362 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5131467-e0df-4968-b7e5-ca5e88ff09cf None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:05.515637 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5131467-e0df-4968-b7e5-ca5e88ff09cf None admin] PATH_INFO: `/v3/services/network` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:05.516343 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5131467-e0df-4968-b7e5-ca5e88ff09cf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:05.518197 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5131467-e0df-4968-b7e5-ca5e88ff09cf None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-a5131467-e0df-4968-b7e5-ca5e88ff09cf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:05.527092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:05.528117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 18:16:05.529566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:05.530588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:05.530707 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 347/663] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:05 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:05.530707 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5131467-e0df-4968-b7e5-ca5e88ff09cf None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:05.616659 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701b44a-ac20-470c-9fc4-252504cddada None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:05.648696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5131467-e0df-4968-b7e5-ca5e88ff09cf None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:05.653334 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f631939-33c5-412d-9b33-67e1fa16e66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:05.653946 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f631939-33c5-412d-9b33-67e1fa16e66e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:05.654224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f631939-33c5-412d-9b33-67e1fa16e66e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:05.654497 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f631939-33c5-412d-9b33-67e1fa16e66e None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:05.655149 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f631939-33c5-412d-9b33-67e1fa16e66e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:05.655447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f631939-33c5-412d-9b33-67e1fa16e66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:05.656857 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f631939-33c5-412d-9b33-67e1fa16e66e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:05.662493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 317/664] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 11 18:16:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:05.663333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f631939-33c5-412d-9b33-67e1fa16e66e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:05.690143 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3a37b-9747-4dab-8434-07c8951f50ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:05.690770 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3a37b-9747-4dab-8434-07c8951f50ed None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:05.691055 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3a37b-9747-4dab-8434-07c8951f50ed None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:05.695740 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3a37b-9747-4dab-8434-07c8951f50ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:05.695740 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3a37b-9747-4dab-8434-07c8951f50ed None admin] RBAC: Adding query filter params (role.id=f89efd1f713043d8835c127de30f53ca, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=685c28640ca84d2b8e85d47e64430cc0) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:05.695740 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3a37b-9747-4dab-8434-07c8951f50ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:05.695740 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3a37b-9747-4dab-8434-07c8951f50ed None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:05.710779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 348/665] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:16:05 2022] GET /identity/v3/role_assignments?user.id=685c28640ca84d2b8e85d47e64430cc0&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=f89efd1f713043d8835c127de30f53ca => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:05.710779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3a37b-9747-4dab-8434-07c8951f50ed None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:05.777899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:05.787440 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:05.813536 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f631939-33c5-412d-9b33-67e1fa16e66e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:05.833644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3a37b-9747-4dab-8434-07c8951f50ed None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:05.860010 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7e708-e7ca-4994-a169-091af812a604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:05.860811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7e708-e7ca-4994-a169-091af812a604 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:05.861151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7e708-e7ca-4994-a169-091af812a604 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:05.861482 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7e708-e7ca-4994-a169-091af812a604 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:05.862338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7e708-e7ca-4994-a169-091af812a604 None admin] RBAC: Adding query filter params (name=network) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:05.862806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7e708-e7ca-4994-a169-091af812a604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:05.865103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7e708-e7ca-4994-a169-091af812a604 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:05.875220 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 318/666] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:05.876989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7e708-e7ca-4994-a169-091af812a604 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:05.893533 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1546c-8c3b-4986-bdde-247dedc63194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:05.894720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1546c-8c3b-4986-bdde-247dedc63194 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:05.895205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1546c-8c3b-4986-bdde-247dedc63194 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:05.897051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1546c-8c3b-4986-bdde-247dedc63194 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:05.898322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1546c-8c3b-4986-bdde-247dedc63194 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:05.898870 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1546c-8c3b-4986-bdde-247dedc63194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:05.901346 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1546c-8c3b-4986-bdde-247dedc63194 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:05.909322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 349/667] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 11 18:16:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:06.010993 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7e708-e7ca-4994-a169-091af812a604 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:06.049293 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e563c-45e3-46f9-a1da-ae932923f5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:06.049907 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e563c-45e3-46f9-a1da-ae932923f5bb None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:06.050189 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e563c-45e3-46f9-a1da-ae932923f5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:06.050463 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e563c-45e3-46f9-a1da-ae932923f5bb None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:06.051146 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e563c-45e3-46f9-a1da-ae932923f5bb None admin] RBAC: Adding query filter params (type=network) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:06.051450 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e563c-45e3-46f9-a1da-ae932923f5bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:06.053587 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e563c-45e3-46f9-a1da-ae932923f5bb None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:06.060593 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 319/668] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:07.017527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0bd7-17bf-4ddc-b934-6fe2d08dfa57 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:07.018041 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0bd7-17bf-4ddc-b934-6fe2d08dfa57 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:07.018041 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0bd7-17bf-4ddc-b934-6fe2d08dfa57 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:07.019593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 350/669] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:07.025656 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432739dc-af21-4b41-a267-4d077792b375 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:07.026084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432739dc-af21-4b41-a267-4d077792b375 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:07.026264 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432739dc-af21-4b41-a267-4d077792b375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:07.046614 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-432739dc-af21-4b41-a267-4d077792b375 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:07.047870 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-432739dc-af21-4b41-a267-4d077792b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:07.050163 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:07.121953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 320/670] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:16:07.455029 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de0bd7-17bf-4ddc-b934-6fe2d08dfa57 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:07.565525 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de0bd7-17bf-4ddc-b934-6fe2d08dfa57 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:07.583772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:07.601916 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f37cca-53dd-4090-9d0e-91e657b6cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:07.602524 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37cca-53dd-4090-9d0e-91e657b6cfd6 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:07.602827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37cca-53dd-4090-9d0e-91e657b6cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:07.607047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37cca-53dd-4090-9d0e-91e657b6cfd6 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:07.607047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f37cca-53dd-4090-9d0e-91e657b6cfd6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:07.607047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f37cca-53dd-4090-9d0e-91e657b6cfd6 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:07.715391 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 351/671] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 11 18:16:07 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:16:08.045740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfd734-8d7d-4a59-bdf0-cd8020763246 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:08.046799 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfd734-8d7d-4a59-bdf0-cd8020763246 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:08.047292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfd734-8d7d-4a59-bdf0-cd8020763246 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:08.049067 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 321/672] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:08.056593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8aba7e-6c7c-4fef-a3d7-1556efe1d946 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:08.057569 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8aba7e-6c7c-4fef-a3d7-1556efe1d946 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:08.058090 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8aba7e-6c7c-4fef-a3d7-1556efe1d946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:08.079440 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-5a8aba7e-6c7c-4fef-a3d7-1556efe1d946 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:08.081105 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-5a8aba7e-6c7c-4fef-a3d7-1556efe1d946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:08.175558 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 352/673] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:08 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:16:08.257584 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e942-8aa4-48e1-ad8f-b184ad69e1f4 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:08.258020 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e942-8aa4-48e1-ad8f-b184ad69e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:08.258295 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e942-8aa4-48e1-ad8f-b184ad69e1f4 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:08.259968 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 322/674] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:16:08.265134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7cc75-855d-45ba-a692-1e973fe7b914 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:08.265426 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7cc75-855d-45ba-a692-1e973fe7b914 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:08.265692 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7cc75-855d-45ba-a692-1e973fe7b914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:08.289141 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-2df7cc75-855d-45ba-a692-1e973fe7b914 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:08.290701 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-2df7cc75-855d-45ba-a692-1e973fe7b914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:08.298323 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ebbef-5c03-4cd9-8be2-039d3bd08561 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:08.298560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ebbef-5c03-4cd9-8be2-039d3bd08561 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:08.298861 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ebbef-5c03-4cd9-8be2-039d3bd08561 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:08.300436 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 323/675] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:08.305508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84144186-a71d-4ecc-8448-53aaf747ac00 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:08.305797 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84144186-a71d-4ecc-8448-53aaf747ac00 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:08.306072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84144186-a71d-4ecc-8448-53aaf747ac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:08.324590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-84144186-a71d-4ecc-8448-53aaf747ac00 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:08.325825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-84144186-a71d-4ecc-8448-53aaf747ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:08.367629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 353/676] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:08 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 18:16:08.396301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 324/677] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:08 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 18:16:08.523340 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7cc75-855d-45ba-a692-1e973fe7b914 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:08.559512 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:08.630464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7cc75-855d-45ba-a692-1e973fe7b914 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:08.666142 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399fd5c-8995-4caa-be88-cfa9f3c4d9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:08.666799 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399fd5c-8995-4caa-be88-cfa9f3c4d9a1 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:08.667083 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399fd5c-8995-4caa-be88-cfa9f3c4d9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:08.667357 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399fd5c-8995-4caa-be88-cfa9f3c4d9a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:08.678378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399fd5c-8995-4caa-be88-cfa9f3c4d9a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-2399fd5c-8995-4caa-be88-cfa9f3c4d9a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:16:08.683145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:08.684061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:08.684933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 354/678] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:16:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:08.690602 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84144186-a71d-4ecc-8448-53aaf747ac00 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:08.703591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399fd5c-8995-4caa-be88-cfa9f3c4d9a1 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:08.775860 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:08.810813 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:08.813037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84144186-a71d-4ecc-8448-53aaf747ac00 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:08.819591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399fd5c-8995-4caa-be88-cfa9f3c4d9a1 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:08.850060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51aa07-af4d-4d9e-a7bd-520b4ca03ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:08.851725 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51aa07-af4d-4d9e-a7bd-520b4ca03ca3 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:08.851725 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51aa07-af4d-4d9e-a7bd-520b4ca03ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:08.851725 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51aa07-af4d-4d9e-a7bd-520b4ca03ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:08.851974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51aa07-af4d-4d9e-a7bd-520b4ca03ca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:08.852255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51aa07-af4d-4d9e-a7bd-520b4ca03ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:08.853730 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51aa07-af4d-4d9e-a7bd-520b4ca03ca3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:08.857766 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01dee7-d99d-4c03-b407-8d04330b1fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:08.858366 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01dee7-d99d-4c03-b407-8d04330b1fdb None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:08.858643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01dee7-d99d-4c03-b407-8d04330b1fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:08.858950 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01dee7-d99d-4c03-b407-8d04330b1fdb None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:08.859678 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01dee7-d99d-4c03-b407-8d04330b1fdb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:08.861068 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01dee7-d99d-4c03-b407-8d04330b1fdb None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:08.863155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 325/679] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:16:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:08.864738 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51aa07-af4d-4d9e-a7bd-520b4ca03ca3 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:08.951306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 355/680] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 11 18:16:08 2022] POST /identity/v3/services => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:16:08.952414 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01dee7-d99d-4c03-b407-8d04330b1fdb None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:08.982824 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51aa07-af4d-4d9e-a7bd-520b4ca03ca3 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:09.028900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:09.045161 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff15320-c15c-4545-8cce-c0e6c90cac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:09.045785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff15320-c15c-4545-8cce-c0e6c90cac63 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:09.046320 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff15320-c15c-4545-8cce-c0e6c90cac63 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:09.046397 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff15320-c15c-4545-8cce-c0e6c90cac63 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:09.047114 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff15320-c15c-4545-8cce-c0e6c90cac63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:09.048579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff15320-c15c-4545-8cce-c0e6c90cac63 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:09.080840 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01dee7-d99d-4c03-b407-8d04330b1fdb None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:09.119971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b92de-9fbb-4a6f-b156-ff4ed42f4a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:09.120896 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b92de-9fbb-4a6f-b156-ff4ed42f4a17 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:09.121182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b92de-9fbb-4a6f-b156-ff4ed42f4a17 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:09.121458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b92de-9fbb-4a6f-b156-ff4ed42f4a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:09.135558 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b92de-9fbb-4a6f-b156-ff4ed42f4a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:09.137067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b92de-9fbb-4a6f-b156-ff4ed42f4a17 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:09.149617 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 326/681] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 11 18:16:08 2022] POST /identity/v3/services => generated 240 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-ea6b92de-9fbb-4a6f-b156-ff4ed42f4a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:16:09.154219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:09.155301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:16:09.156198 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:16:09.156198 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:09.156198 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:09.156198 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 356/682] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:09.163628 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff15320-c15c-4545-8cce-c0e6c90cac63 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:09.294066 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff15320-c15c-4545-8cce-c0e6c90cac63 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:09.331873 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f96c-be91-4360-8680-f86ce4cce0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:09.333525 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f96c-be91-4360-8680-f86ce4cce0a0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:09.334098 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f96c-be91-4360-8680-f86ce4cce0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:09.334592 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f96c-be91-4360-8680-f86ce4cce0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:09.335488 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779f96c-be91-4360-8680-f86ce4cce0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:09.335996 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779f96c-be91-4360-8680-f86ce4cce0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:09.337654 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779f96c-be91-4360-8680-f86ce4cce0a0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:09.352039 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 327/683] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:09.357621 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b92de-9fbb-4a6f-b156-ff4ed42f4a17 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:09.368666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:09.473910 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b92de-9fbb-4a6f-b156-ff4ed42f4a17 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:09.510708 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba88d8-a1b8-49b4-be3e-950d076dda70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:09.511799 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba88d8-a1b8-49b4-be3e-950d076dda70 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:09.512288 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba88d8-a1b8-49b4-be3e-950d076dda70 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:09.512830 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba88d8-a1b8-49b4-be3e-950d076dda70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:09.521478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba88d8-a1b8-49b4-be3e-950d076dda70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:09.523334 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba88d8-a1b8-49b4-be3e-950d076dda70 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-eeba88d8-a1b8-49b4-be3e-950d076dda70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:16:09.535636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:09.536664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:09.537635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:09.537635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:09.537635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:16:09.537635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:16:09.537635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:16:09.537635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:16:09.537635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:16:09.537635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:16:09.537635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:16:09.537635 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:09.540304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 357/684] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 11 18:16:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:09.548080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f96c-be91-4360-8680-f86ce4cce0a0 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:09.603886 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:09.663240 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f96c-be91-4360-8680-f86ce4cce0a0 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:09.699773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b150e-f450-40e3-a76b-c56b25f1c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:09.700378 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b150e-f450-40e3-a76b-c56b25f1c639 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:09.700657 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b150e-f450-40e3-a76b-c56b25f1c639 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:09.700934 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b150e-f450-40e3-a76b-c56b25f1c639 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:09.701667 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b150e-f450-40e3-a76b-c56b25f1c639 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:09.701971 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b150e-f450-40e3-a76b-c56b25f1c639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:09.703424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b150e-f450-40e3-a76b-c56b25f1c639 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:09.723201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 328/685] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 11 18:16:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:09.728500 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba88d8-a1b8-49b4-be3e-950d076dda70 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:09.847039 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:09.855463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba88d8-a1b8-49b4-be3e-950d076dda70 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:09.896652 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2b15-9914-4538-8869-ab5a46d4f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:09.897642 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2b15-9914-4538-8869-ab5a46d4f826 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:09.898130 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2b15-9914-4538-8869-ab5a46d4f826 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:09.898611 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2b15-9914-4538-8869-ab5a46d4f826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:09.910492 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2b15-9914-4538-8869-ab5a46d4f826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:09.912805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2b15-9914-4538-8869-ab5a46d4f826 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-4b2d2b15-9914-4538-8869-ab5a46d4f826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:16:09.928570 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:09.929582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:16:09.930461 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:16:09.930461 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:09.930461 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:09.932613 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 358/686] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:09.941242 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b150e-f450-40e3-a76b-c56b25f1c639 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:10.010136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaaef4-7565-46ed-9f50-1dae8bf86454 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:10.010489 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaaef4-7565-46ed-9f50-1dae8bf86454 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:10.010723 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaaef4-7565-46ed-9f50-1dae8bf86454 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:10.012297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 359/687] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:16:10.017077 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950c37-7e57-41e2-a06e-0fc406d790ac None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:10.017361 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950c37-7e57-41e2-a06e-0fc406d790ac None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:10.017632 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950c37-7e57-41e2-a06e-0fc406d790ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:10.040335 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-2e950c37-7e57-41e2-a06e-0fc406d790ac None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:10.041667 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-2e950c37-7e57-41e2-a06e-0fc406d790ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:10.045761 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:10.048487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b150e-f450-40e3-a76b-c56b25f1c639 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:10.086142 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51d2f3-cbd4-438b-8660-854573eaea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:10.086979 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51d2f3-cbd4-438b-8660-854573eaea2e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:10.087672 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51d2f3-cbd4-438b-8660-854573eaea2e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:10.087820 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51d2f3-cbd4-438b-8660-854573eaea2e None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:10.088576 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51d2f3-cbd4-438b-8660-854573eaea2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:10.089230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51d2f3-cbd4-438b-8660-854573eaea2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:10.090948 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51d2f3-cbd4-438b-8660-854573eaea2e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:10.108582 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 329/688] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:10.109865 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51d2f3-cbd4-438b-8660-854573eaea2e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:10.119225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 360/689] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:16:10.219365 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51d2f3-cbd4-438b-8660-854573eaea2e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:10.259298 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a429db-10ae-4ae6-af6b-3bf78da184c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:10.260238 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a429db-10ae-4ae6-af6b-3bf78da184c6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:10.260741 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a429db-10ae-4ae6-af6b-3bf78da184c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:10.261206 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a429db-10ae-4ae6-af6b-3bf78da184c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:10.268700 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a429db-10ae-4ae6-af6b-3bf78da184c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:10.270580 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a429db-10ae-4ae6-af6b-3bf78da184c6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-f8a429db-10ae-4ae6-af6b-3bf78da184c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:16:10.282504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:10.283461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:10.284390 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:16:10.284390 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:16:10.284390 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:16:10.284390 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:16:10.284390 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:16:10.284390 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:16:10.284390 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:10.284390 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:10.286506 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 330/690] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:16:10.292159 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e950c37-7e57-41e2-a06e-0fc406d790ac None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:10.347757 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:10.405501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e950c37-7e57-41e2-a06e-0fc406d790ac None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:10.444248 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687be35-7c16-4ec9-9797-74f956ec2b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:10.445039 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687be35-7c16-4ec9-9797-74f956ec2b73 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:10.445320 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687be35-7c16-4ec9-9797-74f956ec2b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:10.445588 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687be35-7c16-4ec9-9797-74f956ec2b73 None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:10.446274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687be35-7c16-4ec9-9797-74f956ec2b73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:10.446575 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687be35-7c16-4ec9-9797-74f956ec2b73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:10.448102 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687be35-7c16-4ec9-9797-74f956ec2b73 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:10.451588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a429db-10ae-4ae6-af6b-3bf78da184c6 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:10.466181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 361/691] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:10.467589 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687be35-7c16-4ec9-9797-74f956ec2b73 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:10.481406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:10.559477 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a429db-10ae-4ae6-af6b-3bf78da184c6 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:10.572438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687be35-7c16-4ec9-9797-74f956ec2b73 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:10.581603 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:10.597080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a00e5-6449-409f-8237-06f2b3e1ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:10.597943 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a00e5-6449-409f-8237-06f2b3e1ad34 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:10.598657 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a00e5-6449-409f-8237-06f2b3e1ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:10.599055 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a00e5-6449-409f-8237-06f2b3e1ad34 None admin] PATH_INFO: `/v3/services/image` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:10.599788 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a00e5-6449-409f-8237-06f2b3e1ad34 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:10.601241 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a00e5-6449-409f-8237-06f2b3e1ad34 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:10.609769 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f858c-8ddb-402b-8d50-b178db433727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:10.610608 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f858c-8ddb-402b-8d50-b178db433727 None admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:10.611052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f858c-8ddb-402b-8d50-b178db433727 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:10.611467 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f858c-8ddb-402b-8d50-b178db433727 None admin] PATH_INFO: `/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/685c28640ca84d2b8e85d47e64430cc0/roles/f89efd1f713043d8835c127de30f53ca` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-5e0a00e5-6449-409f-8237-06f2b3e1ad34 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:10.612789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:10.615035 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:10.619301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 331/692] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Aug 11 18:16:10 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:16:10.620108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f858c-8ddb-402b-8d50-b178db433727 None admin] RBAC: Authorizing `identity:create_grant(project_id=a930d08c2f31471bbe6a66f5c626d22f, user_id=685c28640ca84d2b8e85d47e64430cc0, role_id=f89efd1f713043d8835c127de30f53ca)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:10.620108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f858c-8ddb-402b-8d50-b178db433727 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:10.621972 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a00e5-6449-409f-8237-06f2b3e1ad34 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:10.717323 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:10.720818 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 362/693] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:16:10 2022] PUT /identity/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/685c28640ca84d2b8e85d47e64430cc0/roles/f89efd1f713043d8835c127de30f53ca => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:16:10.754445 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a00e5-6449-409f-8237-06f2b3e1ad34 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:10.798495 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c73b1-a122-49b1-8ab7-0b46098df249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:10.799608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c73b1-a122-49b1-8ab7-0b46098df249 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:10.800101 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c73b1-a122-49b1-8ab7-0b46098df249 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:10.800586 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c73b1-a122-49b1-8ab7-0b46098df249 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:10.801485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c73b1-a122-49b1-8ab7-0b46098df249 None admin] RBAC: Adding query filter params (name=image) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:10.802053 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c73b1-a122-49b1-8ab7-0b46098df249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:10.804011 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c73b1-a122-49b1-8ab7-0b46098df249 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:10.810997 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 332/694] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:10.820214 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f858c-8ddb-402b-8d50-b178db433727 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:10.933725 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f858c-8ddb-402b-8d50-b178db433727 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:10.974911 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f3c82-f3e7-4c1d-864f-4b4bd804b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:10.975736 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3c82-f3e7-4c1d-864f-4b4bd804b1db None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:10.976157 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3c82-f3e7-4c1d-864f-4b4bd804b1db None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:10.976569 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f3c82-f3e7-4c1d-864f-4b4bd804b1db None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:10.977337 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f3c82-f3e7-4c1d-864f-4b4bd804b1db None admin] RBAC: Adding query filter params (type=image) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:10.977798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f3c82-f3e7-4c1d-864f-4b4bd804b1db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:10.979382 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f3c82-f3e7-4c1d-864f-4b4bd804b1db None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:10.985139 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 363/695] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:10.993874 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c73b1-a122-49b1-8ab7-0b46098df249 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:11.096942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c73b1-a122-49b1-8ab7-0b46098df249 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:11.135079 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbfd66-a46d-428a-95f1-1b4b10128805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:11.135937 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbfd66-a46d-428a-95f1-1b4b10128805 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:11.136364 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbfd66-a46d-428a-95f1-1b4b10128805 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:11.136781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbfd66-a46d-428a-95f1-1b4b10128805 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:11.137619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbfd66-a46d-428a-95f1-1b4b10128805 None admin] RBAC: Adding query filter params (interface=public, service_id=64ef3d8dc73f4070917934f714ea91d1, region_id=RegionOne) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:11.138099 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbfd66-a46d-428a-95f1-1b4b10128805 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:11.139630 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbfd66-a46d-428a-95f1-1b4b10128805 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:11.148281 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 333/696] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 11 18:16:10 2022] GET /identity/v3/endpoints?service_id=64ef3d8dc73f4070917934f714ea91d1&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:11.153935 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f3c82-f3e7-4c1d-864f-4b4bd804b1db None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:11.194190 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:11.278422 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f3c82-f3e7-4c1d-864f-4b4bd804b1db None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:11.316753 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552707-8094-4394-9488-ec25bd221f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:11.317935 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552707-8094-4394-9488-ec25bd221f36 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:11.318213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552707-8094-4394-9488-ec25bd221f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:11.318484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552707-8094-4394-9488-ec25bd221f36 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:11.319118 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552707-8094-4394-9488-ec25bd221f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:11.320576 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552707-8094-4394-9488-ec25bd221f36 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:11.326543 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 364/697] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 11 18:16:11 2022] GET /identity/v3/services => generated 1002 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:16:11.357668 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210fcf-b581-42e7-b9ff-643cc9c47fef None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:11.358336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210fcf-b581-42e7-b9ff-643cc9c47fef None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:11.358865 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210fcf-b581-42e7-b9ff-643cc9c47fef None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:11.360785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 334/698] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:11.366753 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d226b0-27ea-465a-ad8b-9a1328afef1b None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:11.367062 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d226b0-27ea-465a-ad8b-9a1328afef1b None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:11.367340 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d226b0-27ea-465a-ad8b-9a1328afef1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:11.387819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-c4d226b0-27ea-465a-ad8b-9a1328afef1b None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:11.389055 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-c4d226b0-27ea-465a-ad8b-9a1328afef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:11.474560 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 365/699] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:11.613077 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230e74-708e-45f5-8c7a-fc7402a41eed None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:11.613341 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230e74-708e-45f5-8c7a-fc7402a41eed None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:11.613566 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230e74-708e-45f5-8c7a-fc7402a41eed None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:11.615668 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 335/700] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:11.620940 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794b26c-0e3c-4e30-a052-b77d20060eb0 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:11.621228 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794b26c-0e3c-4e30-a052-b77d20060eb0 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:11.621507 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794b26c-0e3c-4e30-a052-b77d20060eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:11.641256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-f794b26c-0e3c-4e30-a052-b77d20060eb0 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:11.642430 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-f794b26c-0e3c-4e30-a052-b77d20060eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:11.664576 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:11.715056 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 366/701] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:11.805059 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88230e74-708e-45f5-8c7a-fc7402a41eed None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:11.821308 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:11.913721 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88230e74-708e-45f5-8c7a-fc7402a41eed None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:11.949568 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e8d59-5114-4e79-b7ae-d4ec05e2b3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:11.950279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e8d59-5114-4e79-b7ae-d4ec05e2b3c6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:11.950563 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e8d59-5114-4e79-b7ae-d4ec05e2b3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:11.950863 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e8d59-5114-4e79-b7ae-d4ec05e2b3c6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:11.951462 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e8d59-5114-4e79-b7ae-d4ec05e2b3c6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:11.952874 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e8d59-5114-4e79-b7ae-d4ec05e2b3c6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-cb0e8d59-5114-4e79-b7ae-d4ec05e2b3c6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:11.962902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:11.963949 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:11.964781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 336/702] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Aug 11 18:16:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:11.970242 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794b26c-0e3c-4e30-a052-b77d20060eb0 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:12.074178 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794b26c-0e3c-4e30-a052-b77d20060eb0 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:12.083533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e8d59-5114-4e79-b7ae-d4ec05e2b3c6 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:12.109012 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b268f-45c5-436e-8053-c23e9cd2e58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:12.109618 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b268f-45c5-436e-8053-c23e9cd2e58e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:12.109895 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b268f-45c5-436e-8053-c23e9cd2e58e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:12.110162 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b268f-45c5-436e-8053-c23e9cd2e58e None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:12.110836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b268f-45c5-436e-8053-c23e9cd2e58e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:12.111113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b268f-45c5-436e-8053-c23e9cd2e58e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:12.112462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b268f-45c5-436e-8053-c23e9cd2e58e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:12.118228 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 367/703] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 11 18:16:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:12.130265 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b268f-45c5-436e-8053-c23e9cd2e58e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:12.154109 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:12.176045 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:12.206953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e8d59-5114-4e79-b7ae-d4ec05e2b3c6 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:12.243754 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258bcc-dea7-437c-bc74-e5793377e197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:12.244674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258bcc-dea7-437c-bc74-e5793377e197 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:12.245100 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258bcc-dea7-437c-bc74-e5793377e197 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:12.245812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258bcc-dea7-437c-bc74-e5793377e197 None admin] PATH_INFO: `/v3/services/network` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:12.246584 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09258bcc-dea7-437c-bc74-e5793377e197 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:12.248147 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09258bcc-dea7-437c-bc74-e5793377e197 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:12.250761 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b268f-45c5-436e-8053-c23e9cd2e58e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-09258bcc-dea7-437c-bc74-e5793377e197 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:12.258446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:12.259508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 18:16:12.260356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:12.263214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 337/704] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:12 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:16:12.268666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258bcc-dea7-437c-bc74-e5793377e197 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:12.292944 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba9091-d885-4c81-8aaa-1d4d739e9b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:12.293959 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba9091-d885-4c81-8aaa-1d4d739e9b69 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:12.294418 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba9091-d885-4c81-8aaa-1d4d739e9b69 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:12.295007 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba9091-d885-4c81-8aaa-1d4d739e9b69 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:12.295848 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba9091-d885-4c81-8aaa-1d4d739e9b69 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:12.296380 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba9091-d885-4c81-8aaa-1d4d739e9b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:12.298201 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba9091-d885-4c81-8aaa-1d4d739e9b69 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:12.309454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 368/705] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 11 18:16:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:12.310619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba9091-d885-4c81-8aaa-1d4d739e9b69 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:12.402269 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258bcc-dea7-437c-bc74-e5793377e197 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:12.404956 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:12.430262 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba9091-d885-4c81-8aaa-1d4d739e9b69 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:12.447244 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea01bd-8581-4f64-b536-679293f29cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:12.448507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea01bd-8581-4f64-b536-679293f29cf7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:12.449014 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea01bd-8581-4f64-b536-679293f29cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:12.449488 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea01bd-8581-4f64-b536-679293f29cf7 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:12.450785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea01bd-8581-4f64-b536-679293f29cf7 None admin] RBAC: Adding query filter params (name=network) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:12.451565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea01bd-8581-4f64-b536-679293f29cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:12.453135 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea01bd-8581-4f64-b536-679293f29cf7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:12.460251 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 338/706] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:12.469278 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea01bd-8581-4f64-b536-679293f29cf7 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:12.470809 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:12.476403 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bbb35-4de6-4d5c-843a-1e1dee1eb079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:12.477284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bbb35-4de6-4d5c-843a-1e1dee1eb079 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:12.477761 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bbb35-4de6-4d5c-843a-1e1dee1eb079 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:12.478237 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bbb35-4de6-4d5c-843a-1e1dee1eb079 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:12.479132 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bbb35-4de6-4d5c-843a-1e1dee1eb079 None admin] RBAC: Adding query filter params (interface=public, service_id=2e09799aa3904f42bf6a851345b03c25, region_id=RegionOne) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:12.479627 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bbb35-4de6-4d5c-843a-1e1dee1eb079 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:12.481218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bbb35-4de6-4d5c-843a-1e1dee1eb079 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:12.490755 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 369/707] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 11 18:16:12 2022] GET /identity/v3/endpoints?service_id=2e09799aa3904f42bf6a851345b03c25&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:12.496161 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bbb35-4de6-4d5c-843a-1e1dee1eb079 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:12.603585 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea01bd-8581-4f64-b536-679293f29cf7 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:12.612205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bbb35-4de6-4d5c-843a-1e1dee1eb079 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:12.645228 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b0cf2-a148-48a9-87e7-fa4e18cfd59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:12.645929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b0cf2-a148-48a9-87e7-fa4e18cfd59a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:12.646205 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b0cf2-a148-48a9-87e7-fa4e18cfd59a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:12.646485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b0cf2-a148-48a9-87e7-fa4e18cfd59a None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:12.647346 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b0cf2-a148-48a9-87e7-fa4e18cfd59a None admin] RBAC: Adding query filter params (type=network) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:12.647736 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b0cf2-a148-48a9-87e7-fa4e18cfd59a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:12.649309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b0cf2-a148-48a9-87e7-fa4e18cfd59a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:12.649891 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbba751-1602-4b0b-9e4c-c5ac54f68655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:12.650686 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbba751-1602-4b0b-9e4c-c5ac54f68655 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:12.651032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbba751-1602-4b0b-9e4c-c5ac54f68655 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:12.651593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbba751-1602-4b0b-9e4c-c5ac54f68655 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:12.652287 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbba751-1602-4b0b-9e4c-c5ac54f68655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:12.653710 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbba751-1602-4b0b-9e4c-c5ac54f68655 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:12.659432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 339/708] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:12.661555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 370/709] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 11 18:16:12 2022] GET /identity/v3/services => generated 1002 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:16:12.661914 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b0cf2-a148-48a9-87e7-fa4e18cfd59a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:12.757069 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:12.794987 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b0cf2-a148-48a9-87e7-fa4e18cfd59a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:12.833791 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d4e8-30b8-4184-9508-ff33f93bc665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:12.834405 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d4e8-30b8-4184-9508-ff33f93bc665 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:12.834708 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d4e8-30b8-4184-9508-ff33f93bc665 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:12.834990 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d4e8-30b8-4184-9508-ff33f93bc665 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:12.835698 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65d4e8-30b8-4184-9508-ff33f93bc665 None admin] RBAC: Adding query filter params (interface=public, service_id=bf86ac51e9984c69b6f41a595a73fffd, region_id=RegionOne) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:12.836009 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65d4e8-30b8-4184-9508-ff33f93bc665 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:12.837431 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65d4e8-30b8-4184-9508-ff33f93bc665 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:12.843368 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 340/710] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 11 18:16:12 2022] GET /identity/v3/endpoints?service_id=bf86ac51e9984c69b6f41a595a73fffd&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:12.849541 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbba751-1602-4b0b-9e4c-c5ac54f68655 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:12.869323 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:12.968875 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbba751-1602-4b0b-9e4c-c5ac54f68655 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:13.009359 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468dbbc-18f5-4d6b-a619-bcaee3e08b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:13.010302 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468dbbc-18f5-4d6b-a619-bcaee3e08b0b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:13.010822 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468dbbc-18f5-4d6b-a619-bcaee3e08b0b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:13.011293 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468dbbc-18f5-4d6b-a619-bcaee3e08b0b None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:13.012124 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468dbbc-18f5-4d6b-a619-bcaee3e08b0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:13.013735 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468dbbc-18f5-4d6b-a619-bcaee3e08b0b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:13.020407 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 371/711] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 11 18:16:12 2022] GET /identity/v3/services => generated 1002 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:16:13.110287 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ce0a-0ab3-4b6e-8b69-d5ab4f501b19 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:13.110615 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ce0a-0ab3-4b6e-8b69-d5ab4f501b19 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:13.110873 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ce0a-0ab3-4b6e-8b69-d5ab4f501b19 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:13.112523 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 341/712] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:13.118877 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4da25-6b47-48a2-aff9-c1c984ae997d None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:13.128097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4da25-6b47-48a2-aff9-c1c984ae997d None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:13.128097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4da25-6b47-48a2-aff9-c1c984ae997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:13.140188 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-5db4da25-6b47-48a2-aff9-c1c984ae997d None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:13.141410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-5db4da25-6b47-48a2-aff9-c1c984ae997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:13.225016 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 372/713] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:13.557110 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ce0a-0ab3-4b6e-8b69-d5ab4f501b19 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:13.665046 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ce0a-0ab3-4b6e-8b69-d5ab4f501b19 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:13.696429 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:13.701380 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13e0ba-fc5c-46bb-99ad-bfe6f9c640d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:13.702000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13e0ba-fc5c-46bb-99ad-bfe6f9c640d4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:13.702276 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13e0ba-fc5c-46bb-99ad-bfe6f9c640d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:13.702542 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13e0ba-fc5c-46bb-99ad-bfe6f9c640d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:13.714505 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13e0ba-fc5c-46bb-99ad-bfe6f9c640d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-1c13e0ba-fc5c-46bb-99ad-bfe6f9c640d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:16:13.719336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:13.720273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:13.721122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 342/714] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:16:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:13.725888 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9bc76-0673-458f-8444-c7c69150c85d None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:13.726177 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9bc76-0673-458f-8444-c7c69150c85d None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:13.726451 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9bc76-0673-458f-8444-c7c69150c85d None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:13.727621 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13e0ba-fc5c-46bb-99ad-bfe6f9c640d4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:13.728038 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 373/715] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:13.733140 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4828-3647-4262-a557-a02ec909c74a None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:13.733421 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4828-3647-4262-a557-a02ec909c74a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:13.733693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4828-3647-4262-a557-a02ec909c74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:13.759718 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:13.766854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-59cf4828-3647-4262-a557-a02ec909c74a None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:13.768858 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-59cf4828-3647-4262-a557-a02ec909c74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:13.862643 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 374/716] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:16:13.870880 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13e0ba-fc5c-46bb-99ad-bfe6f9c640d4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:13.906906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd399887-62be-4228-87bb-9df249463539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:13.907884 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd399887-62be-4228-87bb-9df249463539 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:13.908416 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd399887-62be-4228-87bb-9df249463539 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:13.908948 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd399887-62be-4228-87bb-9df249463539 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:13.909847 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd399887-62be-4228-87bb-9df249463539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:13.910352 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd399887-62be-4228-87bb-9df249463539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:13.912017 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd399887-62be-4228-87bb-9df249463539 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:13.926827 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 343/717] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:16:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:13.928582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf4828-3647-4262-a557-a02ec909c74a None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:14.035209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf4828-3647-4262-a557-a02ec909c74a None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:14.071978 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad3c12-bec9-4cb2-a16d-eb62e3c90147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:14.072910 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad3c12-bec9-4cb2-a16d-eb62e3c90147 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.073418 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad3c12-bec9-4cb2-a16d-eb62e3c90147 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.073897 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad3c12-bec9-4cb2-a16d-eb62e3c90147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:14.076949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:14.086232 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad3c12-bec9-4cb2-a16d-eb62e3c90147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:14.088145 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad3c12-bec9-4cb2-a16d-eb62e3c90147 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-1aad3c12-bec9-4cb2-a16d-eb62e3c90147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:16:14.103449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:14.104427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:16:14.105371 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:16:14.105371 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:14.105371 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:14.110730 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 375/718] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:14.113927 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd399887-62be-4228-87bb-9df249463539 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:14.178981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:14.189984 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad3c12-bec9-4cb2-a16d-eb62e3c90147 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:14.242680 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd399887-62be-4228-87bb-9df249463539 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:14.294888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813263c-2a75-4fb5-8a23-641ae2e21bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:14.296453 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813263c-2a75-4fb5-8a23-641ae2e21bc2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.296925 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813263c-2a75-4fb5-8a23-641ae2e21bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.297623 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813263c-2a75-4fb5-8a23-641ae2e21bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:14.298749 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813263c-2a75-4fb5-8a23-641ae2e21bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:14.299299 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813263c-2a75-4fb5-8a23-641ae2e21bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:14.302065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813263c-2a75-4fb5-8a23-641ae2e21bc2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:14.306193 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad3c12-bec9-4cb2-a16d-eb62e3c90147 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:14.323057 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 344/719] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:14.325210 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813263c-2a75-4fb5-8a23-641ae2e21bc2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:14.349967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d24246-4c34-4697-90d5-7c5c8cdad959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:14.350646 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d24246-4c34-4697-90d5-7c5c8cdad959 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.350957 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d24246-4c34-4697-90d5-7c5c8cdad959 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.351230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d24246-4c34-4697-90d5-7c5c8cdad959 None admin] PATH_INFO: `/v3/services/image` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:14.351805 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d24246-4c34-4697-90d5-7c5c8cdad959 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:14.353193 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d24246-4c34-4697-90d5-7c5c8cdad959 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-b5d24246-4c34-4697-90d5-7c5c8cdad959 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:14.367327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:14.368572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 18:16:14.369622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:14.372928 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 376/720] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Aug 11 18:16:14 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:16:14.379718 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d24246-4c34-4697-90d5-7c5c8cdad959 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:14.447917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:14.451014 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813263c-2a75-4fb5-8a23-641ae2e21bc2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:14.466535 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:14.488123 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad26e1-14e2-4300-972f-f224c18b4673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:14.489439 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad26e1-14e2-4300-972f-f224c18b4673 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.489952 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad26e1-14e2-4300-972f-f224c18b4673 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.490411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad26e1-14e2-4300-972f-f224c18b4673 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:14.498778 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad26e1-14e2-4300-972f-f224c18b4673 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:14.500369 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad26e1-14e2-4300-972f-f224c18b4673 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:14.504227 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d24246-4c34-4697-90d5-7c5c8cdad959 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-68ad26e1-14e2-4300-972f-f224c18b4673 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:16:14.512839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:14.513811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:14.514783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:14.514783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:14.514783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:16:14.514783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:16:14.514783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:16:14.514783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:16:14.514783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:16:14.514783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:16:14.514783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 18:16:14.514783 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:14.518928 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 345/721] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Aug 11 18:16:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:16:14.520230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad26e1-14e2-4300-972f-f224c18b4673 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:14.545045 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7249ae-be8e-436a-b808-883133ec2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:14.545951 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7249ae-be8e-436a-b808-883133ec2390 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.546415 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7249ae-be8e-436a-b808-883133ec2390 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.546977 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7249ae-be8e-436a-b808-883133ec2390 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:14.547811 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7249ae-be8e-436a-b808-883133ec2390 None admin] RBAC: Adding query filter params (name=image) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:14.548306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7249ae-be8e-436a-b808-883133ec2390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:14.549841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7249ae-be8e-436a-b808-883133ec2390 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:14.560526 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 377/722] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:14.562026 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7249ae-be8e-436a-b808-883133ec2390 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:14.627837 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad26e1-14e2-4300-972f-f224c18b4673 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:14.663171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8b892-2bbc-4d88-af4e-bf484cfbc1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:14.663811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8b892-2bbc-4d88-af4e-bf484cfbc1e0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.664086 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8b892-2bbc-4d88-af4e-bf484cfbc1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.664358 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8b892-2bbc-4d88-af4e-bf484cfbc1e0 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:14.665079 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8b892-2bbc-4d88-af4e-bf484cfbc1e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:14.665563 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8b892-2bbc-4d88-af4e-bf484cfbc1e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:14.667248 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8b892-2bbc-4d88-af4e-bf484cfbc1e0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:14.673464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7249ae-be8e-436a-b808-883133ec2390 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:14.686367 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 346/723] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Aug 11 18:16:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:14.692404 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8b892-2bbc-4d88-af4e-bf484cfbc1e0 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:14.695895 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:14.715132 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d20ae-b2af-41b1-90e7-3ec17a6c28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:14.716094 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d20ae-b2af-41b1-90e7-3ec17a6c28d7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.716748 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d20ae-b2af-41b1-90e7-3ec17a6c28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.717229 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d20ae-b2af-41b1-90e7-3ec17a6c28d7 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:14.718091 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d20ae-b2af-41b1-90e7-3ec17a6c28d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:14.718619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d20ae-b2af-41b1-90e7-3ec17a6c28d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:14.720265 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d20ae-b2af-41b1-90e7-3ec17a6c28d7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:14.730696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 378/724] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:14.731414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:14.732531 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d20ae-b2af-41b1-90e7-3ec17a6c28d7 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:14.813391 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8b892-2bbc-4d88-af4e-bf484cfbc1e0 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:14.851212 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f5323-e31d-4411-aa73-cfee91aa360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:14.852071 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5323-e31d-4411-aa73-cfee91aa360c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.852566 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5323-e31d-4411-aa73-cfee91aa360c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.853020 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5323-e31d-4411-aa73-cfee91aa360c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:14.854466 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d20ae-b2af-41b1-90e7-3ec17a6c28d7 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:14.893280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45415f77-d8f9-471f-84f5-96277d983cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:14.893900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45415f77-d8f9-471f-84f5-96277d983cb2 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.894250 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45415f77-d8f9-471f-84f5-96277d983cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.894592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45415f77-d8f9-471f-84f5-96277d983cb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:14.896083 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45415f77-d8f9-471f-84f5-96277d983cb2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:14.897538 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45415f77-d8f9-471f-84f5-96277d983cb2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:14.929428 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f5323-e31d-4411-aa73-cfee91aa360c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:14.930958 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f5323-e31d-4411-aa73-cfee91aa360c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:14.964982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:14.975720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 379/725] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:16:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:16:14.975720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af72e7-0594-4b62-b64a-2bf4ab4853ad None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.975720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af72e7-0594-4b62-b64a-2bf4ab4853ad None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.975720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af72e7-0594-4b62-b64a-2bf4ab4853ad None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:14.975720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 380/726] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:14.980263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf18073-4d25-439d-b37e-0a11ecc36cf5 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:14.980836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf18073-4d25-439d-b37e-0a11ecc36cf5 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:14.981208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf18073-4d25-439d-b37e-0a11ecc36cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.006962 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-bbf18073-4d25-439d-b37e-0a11ecc36cf5 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:15.008266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-bbf18073-4d25-439d-b37e-0a11ecc36cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:15.052428 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:15.053372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 347/727] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:16:14 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 18:16:15.054388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f5323-e31d-4411-aa73-cfee91aa360c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:15.106043 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 381/728] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:14 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:16:15.178042 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f5323-e31d-4411-aa73-cfee91aa360c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:15.214979 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:15.221005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01002a48-5920-4cdd-bed6-42bf6e7df660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:15.221629 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01002a48-5920-4cdd-bed6-42bf6e7df660 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:15.221917 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01002a48-5920-4cdd-bed6-42bf6e7df660 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:15.222189 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01002a48-5920-4cdd-bed6-42bf6e7df660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.233797 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01002a48-5920-4cdd-bed6-42bf6e7df660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:15.235315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01002a48-5920-4cdd-bed6-42bf6e7df660 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-01002a48-5920-4cdd-bed6-42bf6e7df660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:16:15.251145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:15.252129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:16:15.253408 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:16:15.253408 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:15.253408 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:15.253408 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 348/729] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:15.258828 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf18073-4d25-439d-b37e-0a11ecc36cf5 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:15.342929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f012039-2e3f-461a-b1ed-939a21c2bbdc None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:15.343257 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f012039-2e3f-461a-b1ed-939a21c2bbdc None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:15.343480 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f012039-2e3f-461a-b1ed-939a21c2bbdc None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.345052 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 349/730] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:15.349942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2ecc6-55b0-486e-a082-05c12db9a2a8 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:15.350222 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2ecc6-55b0-486e-a082-05c12db9a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:15.350493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2ecc6-55b0-486e-a082-05c12db9a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.364495 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf18073-4d25-439d-b37e-0a11ecc36cf5 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:15.369514 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-bec2ecc6-55b0-486e-a082-05c12db9a2a8 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:15.371123 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-bec2ecc6-55b0-486e-a082-05c12db9a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:15.402252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de064de-0fdf-4ae7-b593-5a867a5db733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:15.402889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de064de-0fdf-4ae7-b593-5a867a5db733 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:15.403171 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de064de-0fdf-4ae7-b593-5a867a5db733 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:15.403442 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de064de-0fdf-4ae7-b593-5a867a5db733 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.404086 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de064de-0fdf-4ae7-b593-5a867a5db733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:15.404387 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de064de-0fdf-4ae7-b593-5a867a5db733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:15.405742 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de064de-0fdf-4ae7-b593-5a867a5db733 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:15.418187 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 382/731] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:15.423695 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de064de-0fdf-4ae7-b593-5a867a5db733 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:15.445015 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 350/732] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:15 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:16:15.446124 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2ecc6-55b0-486e-a082-05c12db9a2a8 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:15.451575 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:15.544192 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de064de-0fdf-4ae7-b593-5a867a5db733 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:15.576495 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2ecc6-55b0-486e-a082-05c12db9a2a8 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:15.581661 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eaa52-912e-491e-9d18-15aa7e42ab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:15.582439 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eaa52-912e-491e-9d18-15aa7e42ab8b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:15.582816 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eaa52-912e-491e-9d18-15aa7e42ab8b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:15.583156 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eaa52-912e-491e-9d18-15aa7e42ab8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.590597 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323eaa52-912e-491e-9d18-15aa7e42ab8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:15.592098 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323eaa52-912e-491e-9d18-15aa7e42ab8b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:15.594823 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-323eaa52-912e-491e-9d18-15aa7e42ab8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:16:15.605527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:15.609619 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:15.610760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:16:15.610760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:16:15.610760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:16:15.610760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:16:15.610760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:16:15.610760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:16:15.610760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:15.610760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:15.611549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 383/733] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:16:15.612568 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eaa52-912e-491e-9d18-15aa7e42ab8b None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:15.623785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243173-04ae-4e8c-9119-47652f09d45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:15.624770 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243173-04ae-4e8c-9119-47652f09d45a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:15.625233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243173-04ae-4e8c-9119-47652f09d45a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:15.625857 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243173-04ae-4e8c-9119-47652f09d45a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.626452 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd243173-04ae-4e8c-9119-47652f09d45a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:15.628294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd243173-04ae-4e8c-9119-47652f09d45a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-bd243173-04ae-4e8c-9119-47652f09d45a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:15.638999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:15.640184 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 18:16:15.641080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:15.641827 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 351/734] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Aug 11 18:16:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:15.646610 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243173-04ae-4e8c-9119-47652f09d45a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:15.736483 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:15.760903 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eaa52-912e-491e-9d18-15aa7e42ab8b None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:15.767582 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243173-04ae-4e8c-9119-47652f09d45a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:15.797560 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90827454-c71a-46b1-8fdf-2d6e336b008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:15.798171 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90827454-c71a-46b1-8fdf-2d6e336b008e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:15.798453 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90827454-c71a-46b1-8fdf-2d6e336b008e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:15.798756 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90827454-c71a-46b1-8fdf-2d6e336b008e None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.799447 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90827454-c71a-46b1-8fdf-2d6e336b008e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:15.799753 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90827454-c71a-46b1-8fdf-2d6e336b008e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:15.801733 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90827454-c71a-46b1-8fdf-2d6e336b008e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:15.806773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893c089-4757-488e-b9ad-6f0744d13384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:15.807382 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893c089-4757-488e-b9ad-6f0744d13384 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:15.807658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893c089-4757-488e-b9ad-6f0744d13384 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:15.807985 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893c089-4757-488e-b9ad-6f0744d13384 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.808612 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893c089-4757-488e-b9ad-6f0744d13384 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:15.808907 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893c089-4757-488e-b9ad-6f0744d13384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:15.810257 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893c089-4757-488e-b9ad-6f0744d13384 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:15.815062 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 384/735] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:15.819888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 352/736] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 11 18:16:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:15.820045 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90827454-c71a-46b1-8fdf-2d6e336b008e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:15.820977 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893c089-4757-488e-b9ad-6f0744d13384 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:15.870627 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:15.925697 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90827454-c71a-46b1-8fdf-2d6e336b008e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:15.937186 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893c089-4757-488e-b9ad-6f0744d13384 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:15.967346 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63036e-377f-430d-9f9b-3ac15602f798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:15.967967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63036e-377f-430d-9f9b-3ac15602f798 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:15.968247 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63036e-377f-430d-9f9b-3ac15602f798 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:15.968517 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63036e-377f-430d-9f9b-3ac15602f798 None admin] PATH_INFO: `/v3/services/network` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.969088 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63036e-377f-430d-9f9b-3ac15602f798 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:15.970564 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63036e-377f-430d-9f9b-3ac15602f798 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:15.975933 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6f94a-2a20-4b68-b02c-37d710540701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:15.976699 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f94a-2a20-4b68-b02c-37d710540701 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:15.977131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f94a-2a20-4b68-b02c-37d710540701 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:15.977555 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f94a-2a20-4b68-b02c-37d710540701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:15.978432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6f94a-2a20-4b68-b02c-37d710540701 None admin] RBAC: Adding query filter params (role.id=f89efd1f713043d8835c127de30f53ca, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=685c28640ca84d2b8e85d47e64430cc0) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:15.978920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6f94a-2a20-4b68-b02c-37d710540701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-9a63036e-377f-430d-9f9b-3ac15602f798 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:15.979781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:15.980982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:15.982186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 385/737] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:15 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:15.983191 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63036e-377f-430d-9f9b-3ac15602f798 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:15.984044 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6f94a-2a20-4b68-b02c-37d710540701 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:15.991124 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:15.991878 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 353/738] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:16:15 2022] GET /identity/v3/role_assignments?user.id=685c28640ca84d2b8e85d47e64430cc0&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=f89efd1f713043d8835c127de30f53ca => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:15.992832 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6f94a-2a20-4b68-b02c-37d710540701 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:16.106855 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63036e-377f-430d-9f9b-3ac15602f798 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:16.134185 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6f94a-2a20-4b68-b02c-37d710540701 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:16.148534 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc647-b36f-4012-9252-1cbac7bb0cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:16.149100 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:16.149351 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc647-b36f-4012-9252-1cbac7bb0cc2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:16.149709 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc647-b36f-4012-9252-1cbac7bb0cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:16.150059 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc647-b36f-4012-9252-1cbac7bb0cc2 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:16.151001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc647-b36f-4012-9252-1cbac7bb0cc2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:16.151621 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc647-b36f-4012-9252-1cbac7bb0cc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:16.153507 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc647-b36f-4012-9252-1cbac7bb0cc2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:16.163185 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 386/739] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Aug 11 18:16:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:16.168660 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc647-b36f-4012-9252-1cbac7bb0cc2 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:16.185678 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30d603-cd06-453a-8115-8e603fc73300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:16.186387 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30d603-cd06-453a-8115-8e603fc73300 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:16.186754 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30d603-cd06-453a-8115-8e603fc73300 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:16.187036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30d603-cd06-453a-8115-8e603fc73300 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:16.187676 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30d603-cd06-453a-8115-8e603fc73300 None admin] RBAC: Adding query filter params (name=network) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:16.187982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30d603-cd06-453a-8115-8e603fc73300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:16.189445 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30d603-cd06-453a-8115-8e603fc73300 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:16.199477 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 354/740] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:16.200914 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30d603-cd06-453a-8115-8e603fc73300 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:16.285034 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:16.322638 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc647-b36f-4012-9252-1cbac7bb0cc2 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:16.335920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30d603-cd06-453a-8115-8e603fc73300 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:16.357995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273c76-3da0-4808-b791-bba3d671c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:16.359017 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273c76-3da0-4808-b791-bba3d671c35e None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:16.359395 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273c76-3da0-4808-b791-bba3d671c35e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:16.359766 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273c76-3da0-4808-b791-bba3d671c35e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:16.360518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25273c76-3da0-4808-b791-bba3d671c35e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:16.362553 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25273c76-3da0-4808-b791-bba3d671c35e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:16.378487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1241ded-61e9-4d9b-b20d-7183b540e505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:16.379816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1241ded-61e9-4d9b-b20d-7183b540e505 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:16.380303 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1241ded-61e9-4d9b-b20d-7183b540e505 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:16.380587 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1241ded-61e9-4d9b-b20d-7183b540e505 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:16.381214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1241ded-61e9-4d9b-b20d-7183b540e505 None admin] RBAC: Adding query filter params (type=network) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:16.381520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1241ded-61e9-4d9b-b20d-7183b540e505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:16.382942 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1241ded-61e9-4d9b-b20d-7183b540e505 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:16.394684 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 355/741] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:16.397994 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1241ded-61e9-4d9b-b20d-7183b540e505 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:16.432858 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:16.499121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 387/742] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:16:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:16:16.509708 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1241ded-61e9-4d9b-b20d-7183b540e505 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:16.556543 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ccb5f-5e9e-41fc-b19f-40d0c24373dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:16.557074 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ccb5f-5e9e-41fc-b19f-40d0c24373dd None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:16.557349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ccb5f-5e9e-41fc-b19f-40d0c24373dd None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:16.557619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ccb5f-5e9e-41fc-b19f-40d0c24373dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:16.558288 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ccb5f-5e9e-41fc-b19f-40d0c24373dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:16.559732 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ccb5f-5e9e-41fc-b19f-40d0c24373dd None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:16.662030 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 356/743] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:16:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:16:17.416159 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96732e-4f64-49e6-a128-ac482714ac30 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:17.416574 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96732e-4f64-49e6-a128-ac482714ac30 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:17.416758 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96732e-4f64-49e6-a128-ac482714ac30 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:17.418071 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 388/744] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:17.423154 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76f3d6-a212-4b7b-a75e-b5bc9875cd18 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:17.423442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76f3d6-a212-4b7b-a75e-b5bc9875cd18 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:17.423711 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76f3d6-a212-4b7b-a75e-b5bc9875cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:17.443164 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-fa76f3d6-a212-4b7b-a75e-b5bc9875cd18 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:17.444354 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-fa76f3d6-a212-4b7b-a75e-b5bc9875cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:17.518388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 357/745] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:17 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:17.859074 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96732e-4f64-49e6-a128-ac482714ac30 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:17.964824 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96732e-4f64-49e6-a128-ac482714ac30 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:17.989889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:17.999162 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052f25-2e31-48d7-bc2c-072d30004306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:17.999930 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052f25-2e31-48d7-bc2c-072d30004306 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:18.000350 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052f25-2e31-48d7-bc2c-072d30004306 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:18.000781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052f25-2e31-48d7-bc2c-072d30004306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:18.069087 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052f25-2e31-48d7-bc2c-072d30004306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:18.071076 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052f25-2e31-48d7-bc2c-072d30004306 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:18.176542 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 389/746] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:16:17 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 18:16:18.182345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76f3d6-a212-4b7b-a75e-b5bc9875cd18 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:18.198012 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:18.287762 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76f3d6-a212-4b7b-a75e-b5bc9875cd18 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:18.315234 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df735aa3-e22e-4c2b-9b4f-62f8e2a8a180 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:18.315597 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df735aa3-e22e-4c2b-9b4f-62f8e2a8a180 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:18.315853 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df735aa3-e22e-4c2b-9b4f-62f8e2a8a180 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:18.317982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 390/747] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:16:18.323448 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf5828-893b-4a47-a37f-bf3ba1bab900 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:18.323770 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf5828-893b-4a47-a37f-bf3ba1bab900 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:18.324119 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf5828-893b-4a47-a37f-bf3ba1bab900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:18.326317 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfaced-2685-4af5-aad1-526821fc6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:18.326995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfaced-2685-4af5-aad1-526821fc6578 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:18.327276 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfaced-2685-4af5-aad1-526821fc6578 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:18.327545 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfaced-2685-4af5-aad1-526821fc6578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:18.337870 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfaced-2685-4af5-aad1-526821fc6578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:18.339350 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfaced-2685-4af5-aad1-526821fc6578 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:18.343669 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-95bf5828-893b-4a47-a37f-bf3ba1bab900 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:18.345051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-95bf5828-893b-4a47-a37f-bf3ba1bab900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-2ecfaced-2685-4af5-aad1-526821fc6578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:16:18.353956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:18.355000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:16:18.361275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:16:18.361275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:16:18.361275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:18.361275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 358/748] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:18.361275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfaced-2685-4af5-aad1-526821fc6578 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:18.374577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:18.423533 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 391/749] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:18 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:16:18.429816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:18.468553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfaced-2685-4af5-aad1-526821fc6578 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:18.502766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b369da3-f309-4a1f-9820-9b9facfd75df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:18.503367 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b369da3-f309-4a1f-9820-9b9facfd75df None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:18.503640 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b369da3-f309-4a1f-9820-9b9facfd75df None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:18.504479 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b369da3-f309-4a1f-9820-9b9facfd75df None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:18.505191 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b369da3-f309-4a1f-9820-9b9facfd75df None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:18.505499 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b369da3-f309-4a1f-9820-9b9facfd75df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:18.506900 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b369da3-f309-4a1f-9820-9b9facfd75df None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:18.518806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 359/750] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:18.754934 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf5828-893b-4a47-a37f-bf3ba1bab900 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:18.755714 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bc011-1d63-4df7-88d5-742b2097e114 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:18.755997 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bc011-1d63-4df7-88d5-742b2097e114 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:18.756268 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bc011-1d63-4df7-88d5-742b2097e114 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:18.757604 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 360/751] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:16:18.762841 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573738-135b-48d3-b7b5-3026170efa6a None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:18.763084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573738-135b-48d3-b7b5-3026170efa6a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:18.763363 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573738-135b-48d3-b7b5-3026170efa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:18.782186 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1a573738-135b-48d3-b7b5-3026170efa6a None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:18.783407 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1a573738-135b-48d3-b7b5-3026170efa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:18.863982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf5828-893b-4a47-a37f-bf3ba1bab900 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:18.864507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 361/752] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:18 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:16:18.904113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d23ca-ab20-438b-a6ac-81d56c1fcab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:18.904751 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d23ca-ab20-438b-a6ac-81d56c1fcab9 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:18.905064 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d23ca-ab20-438b-a6ac-81d56c1fcab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:18.905380 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d23ca-ab20-438b-a6ac-81d56c1fcab9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:18.905982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d23ca-ab20-438b-a6ac-81d56c1fcab9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:18.907368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d23ca-ab20-438b-a6ac-81d56c1fcab9 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-d61d23ca-ab20-438b-a6ac-81d56c1fcab9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:18.916654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:18.917577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:18.918463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 392/753] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Aug 11 18:16:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:18.923901 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a573738-135b-48d3-b7b5-3026170efa6a None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:18.983632 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:19.027293 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a573738-135b-48d3-b7b5-3026170efa6a None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:19.060789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e9cb8-191b-4cbf-8b0b-3a2215f691b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:19.061381 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9cb8-191b-4cbf-8b0b-3a2215f691b9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:19.061654 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9cb8-191b-4cbf-8b0b-3a2215f691b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:19.061920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9cb8-191b-4cbf-8b0b-3a2215f691b9 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:19.062527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e9cb8-191b-4cbf-8b0b-3a2215f691b9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:19.062855 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e9cb8-191b-4cbf-8b0b-3a2215f691b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:19.064212 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e9cb8-191b-4cbf-8b0b-3a2215f691b9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:19.068937 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 362/754] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 11 18:16:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:19.074753 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d23ca-ab20-438b-a6ac-81d56c1fcab9 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:19.097472 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:19.174115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d23ca-ab20-438b-a6ac-81d56c1fcab9 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:19.190804 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e9cb8-191b-4cbf-8b0b-3a2215f691b9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:19.209545 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf0ae-1ae3-4db5-9d5a-29a62a2888b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:19.210147 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf0ae-1ae3-4db5-9d5a-29a62a2888b2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:19.210428 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf0ae-1ae3-4db5-9d5a-29a62a2888b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:19.210724 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf0ae-1ae3-4db5-9d5a-29a62a2888b2 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:19.211347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaf0ae-1ae3-4db5-9d5a-29a62a2888b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:19.211649 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaf0ae-1ae3-4db5-9d5a-29a62a2888b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:19.213005 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaf0ae-1ae3-4db5-9d5a-29a62a2888b2 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:19.217307 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 393/755] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 11 18:16:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:19.297136 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e9cb8-191b-4cbf-8b0b-3a2215f691b9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:19.317176 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:19.334763 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154f9b-0e13-44b1-92e3-13ae22a7a314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:19.335398 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154f9b-0e13-44b1-92e3-13ae22a7a314 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:19.335675 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154f9b-0e13-44b1-92e3-13ae22a7a314 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:19.335943 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154f9b-0e13-44b1-92e3-13ae22a7a314 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:19.336517 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f154f9b-0e13-44b1-92e3-13ae22a7a314 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:19.337898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f154f9b-0e13-44b1-92e3-13ae22a7a314 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-9f154f9b-0e13-44b1-92e3-13ae22a7a314 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:19.347151 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:19.348953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:19.349789 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 363/756] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:16:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:16:19.355757 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf0ae-1ae3-4db5-9d5a-29a62a2888b2 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:19.445972 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:19.462125 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf0ae-1ae3-4db5-9d5a-29a62a2888b2 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:19.498993 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c32b9-908d-41de-a2b9-7f6dfa0dc7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:19.499589 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c32b9-908d-41de-a2b9-7f6dfa0dc7b7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:19.499865 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c32b9-908d-41de-a2b9-7f6dfa0dc7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:19.500134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c32b9-908d-41de-a2b9-7f6dfa0dc7b7 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:19.500752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c32b9-908d-41de-a2b9-7f6dfa0dc7b7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:19.501052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c32b9-908d-41de-a2b9-7f6dfa0dc7b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:19.502400 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c32b9-908d-41de-a2b9-7f6dfa0dc7b7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:19.507584 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 394/757] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:16:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:19.513729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154f9b-0e13-44b1-92e3-13ae22a7a314 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:19.615862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154f9b-0e13-44b1-92e3-13ae22a7a314 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:19.649919 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fffc6-7206-4812-a14e-57cf40fcc3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:19.650521 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fffc6-7206-4812-a14e-57cf40fcc3ea None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:19.650838 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fffc6-7206-4812-a14e-57cf40fcc3ea None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:19.651115 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fffc6-7206-4812-a14e-57cf40fcc3ea None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:19.651736 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fffc6-7206-4812-a14e-57cf40fcc3ea None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:19.652040 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fffc6-7206-4812-a14e-57cf40fcc3ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:19.653405 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fffc6-7206-4812-a14e-57cf40fcc3ea None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:19.657812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 364/758] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:16:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:21.396791 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018f9f-e7c0-4889-97e6-1bc77f94f5ff None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:21.397319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018f9f-e7c0-4889-97e6-1bc77f94f5ff None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:21.397319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018f9f-e7c0-4889-97e6-1bc77f94f5ff None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:21.398656 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 395/759] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:21.403707 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eee29-7b3b-46d9-8e09-009ae5bc4a69 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:21.404131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eee29-7b3b-46d9-8e09-009ae5bc4a69 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:21.404242 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eee29-7b3b-46d9-8e09-009ae5bc4a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:21.422341 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-bc0eee29-7b3b-46d9-8e09-009ae5bc4a69 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:21.423559 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-bc0eee29-7b3b-46d9-8e09-009ae5bc4a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:21.464726 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:21.488277 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 365/760] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:21 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:21.811057 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7018f9f-e7c0-4889-97e6-1bc77f94f5ff None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:21.850248 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509bb08-8708-4e3b-9a69-026e60a70c26 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:21.850547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509bb08-8708-4e3b-9a69-026e60a70c26 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:21.850870 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509bb08-8708-4e3b-9a69-026e60a70c26 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:21.852213 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 366/761] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:16:21.857157 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321a43-2f42-43bc-848d-8fa098bfd8b4 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:21.857441 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321a43-2f42-43bc-848d-8fa098bfd8b4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:21.857718 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321a43-2f42-43bc-848d-8fa098bfd8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:21.875854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-bb321a43-2f42-43bc-848d-8fa098bfd8b4 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:21.877047 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-bb321a43-2f42-43bc-848d-8fa098bfd8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:21.916503 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7018f9f-e7c0-4889-97e6-1bc77f94f5ff None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:21.945748 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 367/762] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:21 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:16:21.950770 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c89bf8-92b4-4b63-8466-32fc32d8342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:21.951342 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c89bf8-92b4-4b63-8466-32fc32d8342c None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:21.951624 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c89bf8-92b4-4b63-8466-32fc32d8342c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:21.951898 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c89bf8-92b4-4b63-8466-32fc32d8342c None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:21.952536 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c89bf8-92b4-4b63-8466-32fc32d8342c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:21.953981 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c89bf8-92b4-4b63-8466-32fc32d8342c None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:22.017047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 396/763] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 11 18:16:21 2022] POST /identity/v3/services => generated 269 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:16:22.275296 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321a43-2f42-43bc-848d-8fa098bfd8b4 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:22.372624 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321a43-2f42-43bc-848d-8fa098bfd8b4 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:22.380558 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:22.415079 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b45745-c20a-4ee2-a018-e2f2ba3d40bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:22.415835 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45745-c20a-4ee2-a018-e2f2ba3d40bc None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:22.416049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45745-c20a-4ee2-a018-e2f2ba3d40bc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:22.416326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45745-c20a-4ee2-a018-e2f2ba3d40bc None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:22.416975 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b45745-c20a-4ee2-a018-e2f2ba3d40bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:22.418387 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b45745-c20a-4ee2-a018-e2f2ba3d40bc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:22.780717 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 368/764] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 11 18:16:22 2022] POST /identity/v3/services => generated 251 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:16:24.216502 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e36c2-8f6d-4e5f-b558-c1fd6c2ca84a None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:24.217028 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e36c2-8f6d-4e5f-b558-c1fd6c2ca84a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:24.217028 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e36c2-8f6d-4e5f-b558-c1fd6c2ca84a None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:24.218291 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 397/765] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:24.223513 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752639b1-e5a2-41c9-a8bd-9e87f93f5905 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:24.223955 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752639b1-e5a2-41c9-a8bd-9e87f93f5905 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:24.224055 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752639b1-e5a2-41c9-a8bd-9e87f93f5905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:24.243710 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-752639b1-e5a2-41c9-a8bd-9e87f93f5905 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:24.245141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-752639b1-e5a2-41c9-a8bd-9e87f93f5905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:24.316451 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 369/766] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:24 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:24.638379 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e36c2-8f6d-4e5f-b558-c1fd6c2ca84a None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:24.650449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:24.740359 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e36c2-8f6d-4e5f-b558-c1fd6c2ca84a None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:24.776924 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0170b8-d50f-47fe-99fd-9c984f0aa560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:24.777541 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0170b8-d50f-47fe-99fd-9c984f0aa560 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:24.777819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0170b8-d50f-47fe-99fd-9c984f0aa560 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:24.778088 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0170b8-d50f-47fe-99fd-9c984f0aa560 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:24.778676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0170b8-d50f-47fe-99fd-9c984f0aa560 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:24.780068 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0170b8-d50f-47fe-99fd-9c984f0aa560 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-9a0170b8-d50f-47fe-99fd-9c984f0aa560 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:24.789051 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:24.790209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:24.791224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 398/767] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Aug 11 18:16:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:24.796114 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752639b1-e5a2-41c9-a8bd-9e87f93f5905 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:24.886759 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:24.898936 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752639b1-e5a2-41c9-a8bd-9e87f93f5905 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:24.931983 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3cf8e-1d31-4f24-8792-23167fde4390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:24.932667 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3cf8e-1d31-4f24-8792-23167fde4390 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:24.932959 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3cf8e-1d31-4f24-8792-23167fde4390 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:24.933239 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3cf8e-1d31-4f24-8792-23167fde4390 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:24.933877 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3cf8e-1d31-4f24-8792-23167fde4390 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:24.934185 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3cf8e-1d31-4f24-8792-23167fde4390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:24.935600 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3cf8e-1d31-4f24-8792-23167fde4390 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:24.941565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 370/768] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 11 18:16:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:24.947088 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0170b8-d50f-47fe-99fd-9c984f0aa560 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:24.980677 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0ad4e-bb90-462f-86d5-c34047d8c1da None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:24.980929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0ad4e-bb90-462f-86d5-c34047d8c1da None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:24.981138 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0ad4e-bb90-462f-86d5-c34047d8c1da None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:24.982457 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 371/769] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:16:24.987322 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3445-d95c-4e84-a47d-739cc6ab7ef2 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:24.988139 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3445-d95c-4e84-a47d-739cc6ab7ef2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:24.988422 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3445-d95c-4e84-a47d-739cc6ab7ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:25.007485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-a20a3445-d95c-4e84-a47d-739cc6ab7ef2 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:25.008687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-a20a3445-d95c-4e84-a47d-739cc6ab7ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:25.018460 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:25.048350 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0170b8-d50f-47fe-99fd-9c984f0aa560 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:25.076432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 372/770] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:24 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:16:25.080656 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7ba3e-d4a3-4672-acd3-d85821fd3fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:25.081256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ba3e-d4a3-4672-acd3-d85821fd3fd4 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:25.082059 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ba3e-d4a3-4672-acd3-d85821fd3fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:25.082325 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ba3e-d4a3-4672-acd3-d85821fd3fd4 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:25.082968 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7ba3e-d4a3-4672-acd3-d85821fd3fd4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:25.083282 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7ba3e-d4a3-4672-acd3-d85821fd3fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:25.084610 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7ba3e-d4a3-4672-acd3-d85821fd3fd4 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:25.089280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 399/771] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 11 18:16:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:25.095437 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a3445-d95c-4e84-a47d-739cc6ab7ef2 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:25.174853 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:25.193869 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a3445-d95c-4e84-a47d-739cc6ab7ef2 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:25.227786 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22feb3-0e16-4c07-95ea-02cba45619ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:25.228386 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22feb3-0e16-4c07-95ea-02cba45619ac None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:25.228639 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22feb3-0e16-4c07-95ea-02cba45619ac None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:25.228908 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22feb3-0e16-4c07-95ea-02cba45619ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:25.229592 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22feb3-0e16-4c07-95ea-02cba45619ac None admin] RBAC: Adding query filter params (interface=public, service_id=9a9b966fb60d4eb6bff3e835f13672e3, region_id=RegionOne) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:25.229894 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22feb3-0e16-4c07-95ea-02cba45619ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:25.231278 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22feb3-0e16-4c07-95ea-02cba45619ac None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:25.236062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 373/772] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 11 18:16:25 2022] GET /identity/v3/endpoints?service_id=9a9b966fb60d4eb6bff3e835f13672e3&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:25.241703 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7ba3e-d4a3-4672-acd3-d85821fd3fd4 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:25.341558 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7ba3e-d4a3-4672-acd3-d85821fd3fd4 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:25.374045 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d4b3b-7ac6-4b07-8a7a-18d4da47b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:25.374631 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d4b3b-7ac6-4b07-8a7a-18d4da47b841 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:25.374943 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d4b3b-7ac6-4b07-8a7a-18d4da47b841 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:25.375212 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d4b3b-7ac6-4b07-8a7a-18d4da47b841 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:25.375799 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d4b3b-7ac6-4b07-8a7a-18d4da47b841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:25.377140 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d4b3b-7ac6-4b07-8a7a-18d4da47b841 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:25.379915 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:25.384354 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 400/773] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 11 18:16:25 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:16:25.404717 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22feb3-0e16-4c07-95ea-02cba45619ac None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:25.511363 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22feb3-0e16-4c07-95ea-02cba45619ac None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:25.548274 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb3ff4-d885-4b79-9874-611cf68b56c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:25.548920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb3ff4-d885-4b79-9874-611cf68b56c9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:25.549198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb3ff4-d885-4b79-9874-611cf68b56c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:25.549474 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb3ff4-d885-4b79-9874-611cf68b56c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:25.550058 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb3ff4-d885-4b79-9874-611cf68b56c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:25.552140 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb3ff4-d885-4b79-9874-611cf68b56c9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-1ebb3ff4-d885-4b79-9874-611cf68b56c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:25.561068 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:25.562282 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:25.564233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 374/774] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:16:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:25.568223 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d4b3b-7ac6-4b07-8a7a-18d4da47b841 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:25.667343 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d4b3b-7ac6-4b07-8a7a-18d4da47b841 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:25.701082 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae64e77-602c-47f4-bb06-c591a4e4dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:25.701684 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae64e77-602c-47f4-bb06-c591a4e4dc76 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:25.702035 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae64e77-602c-47f4-bb06-c591a4e4dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:25.702236 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae64e77-602c-47f4-bb06-c591a4e4dc76 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:25.702886 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae64e77-602c-47f4-bb06-c591a4e4dc76 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:25.703191 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae64e77-602c-47f4-bb06-c591a4e4dc76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:25.704538 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae64e77-602c-47f4-bb06-c591a4e4dc76 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:25.709656 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 401/775] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:16:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:25.717401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb3ff4-d885-4b79-9874-611cf68b56c9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:25.730936 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:25.823688 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb3ff4-d885-4b79-9874-611cf68b56c9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:25.858194 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e569da5-a695-47b8-a731-dfabd3094cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:25.858832 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e569da5-a695-47b8-a731-dfabd3094cf9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:25.859114 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e569da5-a695-47b8-a731-dfabd3094cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:25.859387 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e569da5-a695-47b8-a731-dfabd3094cf9 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:25.860002 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e569da5-a695-47b8-a731-dfabd3094cf9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:25.860312 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e569da5-a695-47b8-a731-dfabd3094cf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:25.861683 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e569da5-a695-47b8-a731-dfabd3094cf9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:25.867548 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 375/776] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:16:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:25.873995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae64e77-602c-47f4-bb06-c591a4e4dc76 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:25.935252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:25.973671 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae64e77-602c-47f4-bb06-c591a4e4dc76 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:26.006946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a12bd9-aa91-461d-a6e7-23e1eb28f3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:26.007554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12bd9-aa91-461d-a6e7-23e1eb28f3ff None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:26.007871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12bd9-aa91-461d-a6e7-23e1eb28f3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:26.008185 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12bd9-aa91-461d-a6e7-23e1eb28f3ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:26.008894 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a12bd9-aa91-461d-a6e7-23e1eb28f3ff None admin] RBAC: Adding query filter params (interface=public, service_id=dc10c1ceeb914b2b91d9eca7cd97cd9c, region_id=RegionOne) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:26.009205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a12bd9-aa91-461d-a6e7-23e1eb28f3ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:26.010597 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a12bd9-aa91-461d-a6e7-23e1eb28f3ff None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:26.015481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 402/777] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 11 18:16:25 2022] GET /identity/v3/endpoints?service_id=dc10c1ceeb914b2b91d9eca7cd97cd9c&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:26.022290 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e569da5-a695-47b8-a731-dfabd3094cf9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:26.099225 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:26.123180 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e569da5-a695-47b8-a731-dfabd3094cf9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:26.157196 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189949-a6a1-4502-95d3-61e40728ff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:26.157786 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189949-a6a1-4502-95d3-61e40728ff44 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:26.158063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189949-a6a1-4502-95d3-61e40728ff44 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:26.158333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189949-a6a1-4502-95d3-61e40728ff44 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:26.158956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189949-a6a1-4502-95d3-61e40728ff44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:26.160347 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189949-a6a1-4502-95d3-61e40728ff44 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:26.177856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 376/778] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 11 18:16:26 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:16:27.569266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437b70-7c47-4a5b-8964-54c619bbdced None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:27.569800 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437b70-7c47-4a5b-8964-54c619bbdced None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:27.569919 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437b70-7c47-4a5b-8964-54c619bbdced None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:27.571274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 403/779] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:27.576566 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff4053-946a-48b9-a235-37806a3b6227 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:27.576962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff4053-946a-48b9-a235-37806a3b6227 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:27.577128 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff4053-946a-48b9-a235-37806a3b6227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:27.595632 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-d7ff4053-946a-48b9-a235-37806a3b6227 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:27.596852 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-d7ff4053-946a-48b9-a235-37806a3b6227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:27.663605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 377/780] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:27 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:27.994686 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437b70-7c47-4a5b-8964-54c619bbdced None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:28.095890 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437b70-7c47-4a5b-8964-54c619bbdced None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:28.122040 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:28.130164 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850571d1-c162-43fc-8101-9e5820d84eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:28.130814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850571d1-c162-43fc-8101-9e5820d84eb7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:28.131099 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850571d1-c162-43fc-8101-9e5820d84eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:28.131374 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850571d1-c162-43fc-8101-9e5820d84eb7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:28.131948 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850571d1-c162-43fc-8101-9e5820d84eb7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:28.133341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850571d1-c162-43fc-8101-9e5820d84eb7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-850571d1-c162-43fc-8101-9e5820d84eb7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:28.142004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:28.147836 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:28.148794 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 404/781] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Aug 11 18:16:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:28.149688 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff4053-946a-48b9-a235-37806a3b6227 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:28.219480 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:28.253642 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff4053-946a-48b9-a235-37806a3b6227 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:28.287275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf437a51-7da7-45a6-ae1d-ecdb53c23e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:28.287873 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437a51-7da7-45a6-ae1d-ecdb53c23e4e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:28.288152 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437a51-7da7-45a6-ae1d-ecdb53c23e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:28.288425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437a51-7da7-45a6-ae1d-ecdb53c23e4e None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:28.289047 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf437a51-7da7-45a6-ae1d-ecdb53c23e4e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:28.289349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf437a51-7da7-45a6-ae1d-ecdb53c23e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:28.290725 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf437a51-7da7-45a6-ae1d-ecdb53c23e4e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:28.295281 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 378/782] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 11 18:16:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:28.301733 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850571d1-c162-43fc-8101-9e5820d84eb7 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:28.327574 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7eadef-f0bf-470d-a69f-881f68d52a2d None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:28.327862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7eadef-f0bf-470d-a69f-881f68d52a2d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:28.328137 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7eadef-f0bf-470d-a69f-881f68d52a2d None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:28.329464 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 379/783] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:16:28.334333 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a7d2b-88f0-4ca1-bf34-59846102fdee None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:28.334617 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a7d2b-88f0-4ca1-bf34-59846102fdee None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:28.334938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a7d2b-88f0-4ca1-bf34-59846102fdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:28.352856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-bd8a7d2b-88f0-4ca1-bf34-59846102fdee None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:28.354036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-bd8a7d2b-88f0-4ca1-bf34-59846102fdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:28.405075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850571d1-c162-43fc-8101-9e5820d84eb7 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:28.422565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 380/784] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:28 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:16:28.439395 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be476151-a019-49d1-a75a-15f515cf38a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:28.439988 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be476151-a019-49d1-a75a-15f515cf38a6 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:28.440270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be476151-a019-49d1-a75a-15f515cf38a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:28.440628 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be476151-a019-49d1-a75a-15f515cf38a6 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:28.441249 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be476151-a019-49d1-a75a-15f515cf38a6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:28.441547 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be476151-a019-49d1-a75a-15f515cf38a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:28.442951 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be476151-a019-49d1-a75a-15f515cf38a6 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:28.447560 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 405/785] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Aug 11 18:16:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:28.453356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a7d2b-88f0-4ca1-bf34-59846102fdee None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:28.513542 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:28.551283 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a7d2b-88f0-4ca1-bf34-59846102fdee None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:28.584674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e2ae1-fa25-42b3-8fb3-a97ee03027f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:28.585305 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e2ae1-fa25-42b3-8fb3-a97ee03027f3 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:28.585543 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e2ae1-fa25-42b3-8fb3-a97ee03027f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:28.585815 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e2ae1-fa25-42b3-8fb3-a97ee03027f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:28.586468 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e2ae1-fa25-42b3-8fb3-a97ee03027f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:28.587874 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e2ae1-fa25-42b3-8fb3-a97ee03027f3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:28.668638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 381/786] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:16:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:16:28.752547 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be476151-a019-49d1-a75a-15f515cf38a6 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:28.812824 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:28.858180 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be476151-a019-49d1-a75a-15f515cf38a6 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:28.899045 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8bea4-86b4-4411-81e3-fdb34f41d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:28.899674 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8bea4-86b4-4411-81e3-fdb34f41d04f None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:28.899954 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8bea4-86b4-4411-81e3-fdb34f41d04f None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:28.900222 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8bea4-86b4-4411-81e3-fdb34f41d04f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:28.900789 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8bea4-86b4-4411-81e3-fdb34f41d04f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:28.902146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8bea4-86b4-4411-81e3-fdb34f41d04f None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-bae8bea4-86b4-4411-81e3-fdb34f41d04f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:28.911280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:28.912464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 18:16:28.913518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:28.914888 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 406/787] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:16:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:28.918518 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e2ae1-fa25-42b3-8fb3-a97ee03027f3 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:29.018274 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e2ae1-fa25-42b3-8fb3-a97ee03027f3 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:29.036408 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:29.052580 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab7d91-9851-4ab2-b303-7775982b5b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:29.053182 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab7d91-9851-4ab2-b303-7775982b5b83 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:29.053488 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab7d91-9851-4ab2-b303-7775982b5b83 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:29.053729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab7d91-9851-4ab2-b303-7775982b5b83 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:29.054350 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab7d91-9851-4ab2-b303-7775982b5b83 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:29.054651 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab7d91-9851-4ab2-b303-7775982b5b83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:29.056060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab7d91-9851-4ab2-b303-7775982b5b83 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:29.060658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 382/788] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:16:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:29.067083 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8bea4-86b4-4411-81e3-fdb34f41d04f None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:29.166849 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8bea4-86b4-4411-81e3-fdb34f41d04f None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:29.183268 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:29.201026 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291562da-033c-4314-8f7e-78eebf0c65f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:29.201630 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291562da-033c-4314-8f7e-78eebf0c65f9 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:29.201914 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291562da-033c-4314-8f7e-78eebf0c65f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:29.202189 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291562da-033c-4314-8f7e-78eebf0c65f9 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:29.202845 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291562da-033c-4314-8f7e-78eebf0c65f9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:29.203151 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291562da-033c-4314-8f7e-78eebf0c65f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:29.204522 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291562da-033c-4314-8f7e-78eebf0c65f9 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:29.210085 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 407/789] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Aug 11 18:16:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:29.215798 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab7d91-9851-4ab2-b303-7775982b5b83 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:29.315295 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab7d91-9851-4ab2-b303-7775982b5b83 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:29.349678 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0948a-74ed-42e8-bcee-7dd51f3359be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:29.350197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0948a-74ed-42e8-bcee-7dd51f3359be None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:29.350477 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0948a-74ed-42e8-bcee-7dd51f3359be None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:29.350788 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0948a-74ed-42e8-bcee-7dd51f3359be None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:29.351443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0948a-74ed-42e8-bcee-7dd51f3359be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:29.352796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0948a-74ed-42e8-bcee-7dd51f3359be None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:29.442620 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 383/790] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:16:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:16:30.883625 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0a34-8688-413e-b3de-11ad14065167 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:30.884162 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0a34-8688-413e-b3de-11ad14065167 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:30.884162 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0a34-8688-413e-b3de-11ad14065167 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:30.885515 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 408/791] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:30.890993 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368cab-478b-4573-8757-09f5abe4d036 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:30.891395 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368cab-478b-4573-8757-09f5abe4d036 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:30.891548 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368cab-478b-4573-8757-09f5abe4d036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:30.910590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-bc368cab-478b-4573-8757-09f5abe4d036 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:30.911833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-bc368cab-478b-4573-8757-09f5abe4d036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:30.943087 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:30.984816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 384/792] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:30 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:31.313933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f0a34-8688-413e-b3de-11ad14065167 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:31.414168 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f0a34-8688-413e-b3de-11ad14065167 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:31.447009 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3381e-d4c9-4ad8-96bb-f7264f4118a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:31.447631 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3381e-d4c9-4ad8-96bb-f7264f4118a1 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:31.447914 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3381e-d4c9-4ad8-96bb-f7264f4118a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:31.448191 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3381e-d4c9-4ad8-96bb-f7264f4118a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:31.448776 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3381e-d4c9-4ad8-96bb-f7264f4118a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:31.450160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3381e-d4c9-4ad8-96bb-f7264f4118a1 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-cba3381e-d4c9-4ad8-96bb-f7264f4118a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:31.460271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:31.461409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:31.462266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 409/793] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:31.467930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368cab-478b-4573-8757-09f5abe4d036 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:31.567150 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368cab-478b-4573-8757-09f5abe4d036 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:31.600607 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f34e7d-318b-4644-9005-23a3d49ed96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:31.601213 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34e7d-318b-4644-9005-23a3d49ed96f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:31.601502 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34e7d-318b-4644-9005-23a3d49ed96f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:31.601777 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34e7d-318b-4644-9005-23a3d49ed96f None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:31.602404 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f34e7d-318b-4644-9005-23a3d49ed96f None admin] RBAC: Adding query filter params (name=compute) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:31.602802 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f34e7d-318b-4644-9005-23a3d49ed96f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:31.604180 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f34e7d-318b-4644-9005-23a3d49ed96f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:31.608795 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 385/794] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:31.614848 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3381e-d4c9-4ad8-96bb-f7264f4118a1 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:31.619671 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39768dd-7151-4f34-8e90-26bdce7a9b0b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:31.619951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39768dd-7151-4f34-8e90-26bdce7a9b0b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:31.620220 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39768dd-7151-4f34-8e90-26bdce7a9b0b None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:31.621545 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 386/795] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:16:31.626394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539c74f-7716-4f21-ab4c-391f340c0b22 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:31.626688 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539c74f-7716-4f21-ab4c-391f340c0b22 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:31.626975 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539c74f-7716-4f21-ab4c-391f340c0b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:31.645427 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f539c74f-7716-4f21-ab4c-391f340c0b22 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:31.646597 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f539c74f-7716-4f21-ab4c-391f340c0b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:31.662177 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:31.669015 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:31.711885 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 387/796] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:16:31.716079 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3381e-d4c9-4ad8-96bb-f7264f4118a1 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:31.754002 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b08ce-f21d-4f47-ac52-9e73f48b5d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:31.754603 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b08ce-f21d-4f47-ac52-9e73f48b5d77 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:31.754915 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b08ce-f21d-4f47-ac52-9e73f48b5d77 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:31.755188 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b08ce-f21d-4f47-ac52-9e73f48b5d77 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:31.755810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b08ce-f21d-4f47-ac52-9e73f48b5d77 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:31.756113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b08ce-f21d-4f47-ac52-9e73f48b5d77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:31.757465 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b08ce-f21d-4f47-ac52-9e73f48b5d77 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:31.761815 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 410/797] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:32.040308 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539c74f-7716-4f21-ab4c-391f340c0b22 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:32.138166 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539c74f-7716-4f21-ab4c-391f340c0b22 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:32.171417 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:32.172011 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:32.172289 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:32.172561 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:32.173187 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:32.174695 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:32.177289 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: WARNING keystone.server.flask.common [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 11 18:16:32.219308 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.sql.core [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 18:16:32.219308 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 11 18:16:32.219308 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [parameters: {'id': '5de0583cf4de466caa76f413a797b6a5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 11 18:16:32.219308 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88294) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5de0583cf4de466caa76f413a797b6a5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5de0583cf4de466caa76f413a797b6a5. Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application conn.query(q) Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 18:16:32.235814 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result.read() Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 11 18:16:32.236819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application next(self.gen) Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application yield resource Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application next(self.gen) Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise self.value Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application session.commit() Aug 11 18:16:32.238487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.session.flush() Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application compat.raise_( Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 18:16:32.239757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 18:16:32.241000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application conn.query(q) Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result.read() Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 18:16:32.242201 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [parameters: {'id': '5de0583cf4de466caa76f413a797b6a5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:32.243316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:32.244744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:32.246219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:32.246219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 11 18:16:32.246219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 11 18:16:32.246219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:32.246219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:32.246219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 11 18:16:32.246219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 11 18:16:32.246219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5de0583cf4de466caa76f413a797b6a5. Aug 11 18:16:32.246219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:32.246219 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 388/798] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Aug 11 18:16:32 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:32.247210 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b08ce-f21d-4f47-ac52-9e73f48b5d77 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:32.341462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b08ce-f21d-4f47-ac52-9e73f48b5d77 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:32.350750 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:32.374532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbced013-90fe-4098-8042-37dc3fde6aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:32.375192 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced013-90fe-4098-8042-37dc3fde6aa9 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:32.375583 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced013-90fe-4098-8042-37dc3fde6aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:32.375863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced013-90fe-4098-8042-37dc3fde6aa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:32.383089 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbced013-90fe-4098-8042-37dc3fde6aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:32.384785 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbced013-90fe-4098-8042-37dc3fde6aa9 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-fbced013-90fe-4098-8042-37dc3fde6aa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:16:32.396532 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:32.397629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:32.398762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:16:32.398762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:16:32.398762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:16:32.398762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:16:32.398762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:16:32.398762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:16:32.398762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:16:32.398762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:32.398762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 411/799] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:32.405500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:32.422540 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:32.511955 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373eee1-7598-4411-ae5b-257e0026ce45 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:32.544517 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6e058-c43d-4167-a9f5-6aa8f80976ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:32.545110 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6e058-c43d-4167-a9f5-6aa8f80976ad None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:32.545389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6e058-c43d-4167-a9f5-6aa8f80976ad None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:32.545658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6e058-c43d-4167-a9f5-6aa8f80976ad None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:32.546305 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6e058-c43d-4167-a9f5-6aa8f80976ad None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:32.546603 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6e058-c43d-4167-a9f5-6aa8f80976ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:32.548244 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6e058-c43d-4167-a9f5-6aa8f80976ad None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:32.568580 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 389/800] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:16:33.972604 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31bd59-8006-4ffd-8dca-bb8a05fde893 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:33.973148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31bd59-8006-4ffd-8dca-bb8a05fde893 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:33.973148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31bd59-8006-4ffd-8dca-bb8a05fde893 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:33.974474 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 412/801] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:33.979847 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bec89-78bc-4dd6-bbdf-b2c0d092c1db None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:33.980262 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bec89-78bc-4dd6-bbdf-b2c0d092c1db None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:33.980400 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bec89-78bc-4dd6-bbdf-b2c0d092c1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:33.999246 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-fe0bec89-78bc-4dd6-bbdf-b2c0d092c1db None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:34.000693 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-fe0bec89-78bc-4dd6-bbdf-b2c0d092c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:34.066492 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 390/802] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:33 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:34.395419 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31bd59-8006-4ffd-8dca-bb8a05fde893 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:34.496180 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31bd59-8006-4ffd-8dca-bb8a05fde893 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:34.530104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40681d1f-5b6f-47eb-bd3b-360ce85dfb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:34.530726 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40681d1f-5b6f-47eb-bd3b-360ce85dfb92 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:34.531012 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40681d1f-5b6f-47eb-bd3b-360ce85dfb92 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:34.531287 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40681d1f-5b6f-47eb-bd3b-360ce85dfb92 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:34.531937 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40681d1f-5b6f-47eb-bd3b-360ce85dfb92 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:34.533295 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40681d1f-5b6f-47eb-bd3b-360ce85dfb92 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:34.593556 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 413/803] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 11 18:16:34 2022] POST /identity/v3/services => generated 242 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:16:34.795053 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011acd2c-1d15-4144-88d7-c7bd97dbb5d1 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:34.795341 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011acd2c-1d15-4144-88d7-c7bd97dbb5d1 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:34.795627 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011acd2c-1d15-4144-88d7-c7bd97dbb5d1 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:34.796969 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 391/804] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:34.802696 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaee012-7133-4082-96f6-6415cfa7e1c5 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:34.802976 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaee012-7133-4082-96f6-6415cfa7e1c5 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:34.803253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaee012-7133-4082-96f6-6415cfa7e1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:34.821658 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-caaee012-7133-4082-96f6-6415cfa7e1c5 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:34.822871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-caaee012-7133-4082-96f6-6415cfa7e1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:34.846045 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:34.895743 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 414/805] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:34 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:35.224178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011acd2c-1d15-4144-88d7-c7bd97dbb5d1 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:35.227978 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:35.324938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011acd2c-1d15-4144-88d7-c7bd97dbb5d1 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:35.357746 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfcdde-3e5f-4587-bc1b-6e57520eee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:35.358338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfcdde-3e5f-4587-bc1b-6e57520eee9a None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:35.358618 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfcdde-3e5f-4587-bc1b-6e57520eee9a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:35.358917 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfcdde-3e5f-4587-bc1b-6e57520eee9a None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:35.359553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfcdde-3e5f-4587-bc1b-6e57520eee9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:35.360965 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfcdde-3e5f-4587-bc1b-6e57520eee9a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:35.407310 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.sql.core [None req-6edfcdde-3e5f-4587-bc1b-6e57520eee9a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 18:16:35.407310 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 11 18:16:35.407310 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [parameters: {'user_id': '301a4ee765314327857b2622ae4db080', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 11 18:16:35.407310 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88294) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-6edfcdde-3e5f-4587-bc1b-6e57520eee9a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application conn.query(q) Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result.read() Aug 11 18:16:35.414156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 18:16:35.415190 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application next(self.gen) Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application yield resource Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application next(self.gen) Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise self.value Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application session.commit() Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 18:16:35.416528 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.session.flush() Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application compat.raise_( Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 18:16:35.417648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 18:16:35.418803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application conn.query(q) Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result.read() Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 18:16:35.419840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [parameters: {'user_id': '301a4ee765314327857b2622ae4db080', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:35.420989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 11 18:16:35.421962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 11 18:16:35.423155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 11 18:16:35.423155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 11 18:16:35.423155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 18:16:35.423155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 18:16:35.423155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 11 18:16:35.423155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:35.423155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 392/806] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Aug 11 18:16:35 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:35.423627 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaee012-7133-4082-96f6-6415cfa7e1c5 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:35.519862 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaee012-7133-4082-96f6-6415cfa7e1c5 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:35.553307 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635a666-f9a1-4ff0-b449-6215a39d10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:35.553922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a666-f9a1-4ff0-b449-6215a39d10a1 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:35.554197 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a666-f9a1-4ff0-b449-6215a39d10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:35.554466 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a666-f9a1-4ff0-b449-6215a39d10a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:35.561242 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635a666-f9a1-4ff0-b449-6215a39d10a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:35.562654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635a666-f9a1-4ff0-b449-6215a39d10a1 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-4635a666-f9a1-4ff0-b449-6215a39d10a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:16:35.573788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:35.574953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:35.576182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:35.576182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:35.576182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:16:35.576182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:16:35.576182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:16:35.576182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:16:35.576182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:16:35.576182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:16:35.576182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 18:16:35.576182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:35.578968 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 415/807] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:16:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:35.581325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfcdde-3e5f-4587-bc1b-6e57520eee9a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:35.648679 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:35.683362 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfcdde-3e5f-4587-bc1b-6e57520eee9a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:35.718985 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04574836-b050-437a-aa95-aca494ea941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:35.719849 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04574836-b050-437a-aa95-aca494ea941d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:35.720751 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04574836-b050-437a-aa95-aca494ea941d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:35.721024 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04574836-b050-437a-aa95-aca494ea941d None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:35.722254 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04574836-b050-437a-aa95-aca494ea941d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:35.722556 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04574836-b050-437a-aa95-aca494ea941d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:35.724239 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04574836-b050-437a-aa95-aca494ea941d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:35.763497 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 393/808] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Aug 11 18:16:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:36.803004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfdbb-2b81-45fc-938b-e2371b3e9c10 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:36.803490 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfdbb-2b81-45fc-938b-e2371b3e9c10 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:36.803575 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfdbb-2b81-45fc-938b-e2371b3e9c10 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:36.804871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 416/809] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:36.810160 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c4da9-d09e-41ae-b4df-4192331fe3e6 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:36.810586 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c4da9-d09e-41ae-b4df-4192331fe3e6 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:36.810744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c4da9-d09e-41ae-b4df-4192331fe3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:36.829970 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ba5c4da9-d09e-41ae-b4df-4192331fe3e6 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:36.832610 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ba5c4da9-d09e-41ae-b4df-4192331fe3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:36.897086 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 394/810] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:36 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:37.218935 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bfdbb-2b81-45fc-938b-e2371b3e9c10 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:37.235376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:37.320092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bfdbb-2b81-45fc-938b-e2371b3e9c10 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:37.352046 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562779a-30dd-4e90-b167-370ea26ca2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:37.352648 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562779a-30dd-4e90-b167-370ea26ca2bf None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:37.352926 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562779a-30dd-4e90-b167-370ea26ca2bf None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:37.353198 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562779a-30dd-4e90-b167-370ea26ca2bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:37.353762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562779a-30dd-4e90-b167-370ea26ca2bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:37.355161 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562779a-30dd-4e90-b167-370ea26ca2bf None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-c562779a-30dd-4e90-b167-370ea26ca2bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:37.364208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:37.365378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:16:37.366376 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 417/811] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:37.371417 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c4da9-d09e-41ae-b4df-4192331fe3e6 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:37.424543 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:37.467569 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c4da9-d09e-41ae-b4df-4192331fe3e6 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:37.499911 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cdeff-686a-4d9a-8845-e560ead86ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:37.500498 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cdeff-686a-4d9a-8845-e560ead86ca7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:37.500772 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cdeff-686a-4d9a-8845-e560ead86ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:37.501039 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cdeff-686a-4d9a-8845-e560ead86ca7 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:37.501652 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cdeff-686a-4d9a-8845-e560ead86ca7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:37.501947 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cdeff-686a-4d9a-8845-e560ead86ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:37.503869 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cdeff-686a-4d9a-8845-e560ead86ca7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:37.508451 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 395/812] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:37.514234 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562779a-30dd-4e90-b167-370ea26ca2bf None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:37.591920 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:37.612906 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562779a-30dd-4e90-b167-370ea26ca2bf None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:37.646877 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd107bec-8075-4994-bf2e-df51befff7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:37.647465 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd107bec-8075-4994-bf2e-df51befff7e7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:37.647744 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd107bec-8075-4994-bf2e-df51befff7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:37.648015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd107bec-8075-4994-bf2e-df51befff7e7 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:37.648634 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd107bec-8075-4994-bf2e-df51befff7e7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:37.648935 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd107bec-8075-4994-bf2e-df51befff7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:37.650277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd107bec-8075-4994-bf2e-df51befff7e7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:37.654884 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 418/813] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:37.660910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cdeff-686a-4d9a-8845-e560ead86ca7 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:37.760083 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cdeff-686a-4d9a-8845-e560ead86ca7 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:37.776906 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:37.793189 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf8388-da97-45b8-9c58-49cadd250117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:37.794313 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf8388-da97-45b8-9c58-49cadd250117 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:37.794313 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf8388-da97-45b8-9c58-49cadd250117 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:37.794313 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf8388-da97-45b8-9c58-49cadd250117 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:37.795023 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf8388-da97-45b8-9c58-49cadd250117 None admin] RBAC: Adding query filter params (interface=public, service_id=e4031783f6ba425985023df089fddc93, region_id=RegionOne) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:37.795330 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf8388-da97-45b8-9c58-49cadd250117 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:37.796683 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf8388-da97-45b8-9c58-49cadd250117 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:37.802187 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 396/814] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 11 18:16:37 2022] GET /identity/v3/endpoints?service_id=e4031783f6ba425985023df089fddc93&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:37.807891 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd107bec-8075-4994-bf2e-df51befff7e7 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:37.909274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd107bec-8075-4994-bf2e-df51befff7e7 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:37.942754 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706528f6-0528-426e-b0e1-e481fbdc5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:37.943341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706528f6-0528-426e-b0e1-e481fbdc5e07 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:37.943621 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706528f6-0528-426e-b0e1-e481fbdc5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:37.943889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706528f6-0528-426e-b0e1-e481fbdc5e07 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:37.944474 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706528f6-0528-426e-b0e1-e481fbdc5e07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:37.945807 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706528f6-0528-426e-b0e1-e481fbdc5e07 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:37.951666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 419/815] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 11 18:16:37 2022] GET /identity/v3/services => generated 1728 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:16:40.103148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e4007-bdf6-46ad-a8a8-c18e44e10ecd None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:40.103652 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e4007-bdf6-46ad-a8a8-c18e44e10ecd None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:40.103652 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e4007-bdf6-46ad-a8a8-c18e44e10ecd None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:40.104969 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 397/816] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:16:40.109942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aa229-0331-41b8-8559-6a76b9ccae9a None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:40.110379 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aa229-0331-41b8-8559-6a76b9ccae9a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:40.110472 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aa229-0331-41b8-8559-6a76b9ccae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:40.123297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:40.129533 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-2b1aa229-0331-41b8-8559-6a76b9ccae9a None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:16:40.130741 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-2b1aa229-0331-41b8-8559-6a76b9ccae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:16:40.194467 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 420/817] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:16:40 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:16:40.515514 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e4007-bdf6-46ad-a8a8-c18e44e10ecd None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:40.615577 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e4007-bdf6-46ad-a8a8-c18e44e10ecd None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:40.648417 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf2c4-27ad-436e-9a42-be1d539c92c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:40.649025 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf2c4-27ad-436e-9a42-be1d539c92c8 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:40.649304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf2c4-27ad-436e-9a42-be1d539c92c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:40.649577 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf2c4-27ad-436e-9a42-be1d539c92c8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:40.650144 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccf2c4-27ad-436e-9a42-be1d539c92c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:40.651541 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccf2c4-27ad-436e-9a42-be1d539c92c8 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-14ccf2c4-27ad-436e-9a42-be1d539c92c8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:16:40.661141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:16:40.662304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:16:40.663349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 398/818] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:16:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:16:40.668173 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aa229-0331-41b8-8559-6a76b9ccae9a None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:40.763357 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aa229-0331-41b8-8559-6a76b9ccae9a None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:40.797168 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309efb1-6f2e-4e7a-9991-bb77da5d0dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:40.797694 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309efb1-6f2e-4e7a-9991-bb77da5d0dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:40.797972 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309efb1-6f2e-4e7a-9991-bb77da5d0dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:40.798243 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309efb1-6f2e-4e7a-9991-bb77da5d0dd0 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:40.798927 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309efb1-6f2e-4e7a-9991-bb77da5d0dd0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:40.799389 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309efb1-6f2e-4e7a-9991-bb77da5d0dd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:40.800744 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309efb1-6f2e-4e7a-9991-bb77da5d0dd0 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:40.802471 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:40.805760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 421/819] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:40.811490 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf2c4-27ad-436e-9a42-be1d539c92c8 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:40.857866 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:40.912522 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf2c4-27ad-436e-9a42-be1d539c92c8 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:40.944939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9423c-9878-4444-9f57-ad36a39d38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:40.945524 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9423c-9878-4444-9f57-ad36a39d38d2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:40.945805 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9423c-9878-4444-9f57-ad36a39d38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:40.946071 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9423c-9878-4444-9f57-ad36a39d38d2 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:40.946698 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9423c-9878-4444-9f57-ad36a39d38d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:16:40.947002 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9423c-9878-4444-9f57-ad36a39d38d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:40.948365 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9423c-9878-4444-9f57-ad36a39d38d2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:40.952960 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 399/820] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Aug 11 18:16:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:16:40.959528 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309efb1-6f2e-4e7a-9991-bb77da5d0dd0 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:16:41.060276 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309efb1-6f2e-4e7a-9991-bb77da5d0dd0 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:16:41.093846 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed16a2-3b78-4f6e-bb9e-179292a268b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:16:41.094439 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed16a2-3b78-4f6e-bb9e-179292a268b4 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:16:41.094750 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed16a2-3b78-4f6e-bb9e-179292a268b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:16:41.095025 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed16a2-3b78-4f6e-bb9e-179292a268b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:16:41.096220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed16a2-3b78-4f6e-bb9e-179292a268b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:16:41.097612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed16a2-3b78-4f6e-bb9e-179292a268b4 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:16:41.175462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 422/821] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:16:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:16:50.950616 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=45 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:16:51.170703 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:00.775873 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c449-ee88-4695-8c6b-0cb9a8c849a1 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:00.776376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c449-ee88-4695-8c6b-0cb9a8c849a1 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:00.776489 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c449-ee88-4695-8c6b-0cb9a8c849a1 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:00.777773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 400/822] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:00.782958 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e55b41-9fcb-4ace-9b88-d353f4b91a3e None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:00.783409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e55b41-9fcb-4ace-9b88-d353f4b91a3e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:00.783509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e55b41-9fcb-4ace-9b88-d353f4b91a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:00.802576 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-46e55b41-9fcb-4ace-9b88-d353f4b91a3e None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:00.803800 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-46e55b41-9fcb-4ace-9b88-d353f4b91a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:00.875347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 423/823] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:00 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:18:01.202419 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205c449-ee88-4695-8c6b-0cb9a8c849a1 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:01.303857 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205c449-ee88-4695-8c6b-0cb9a8c849a1 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:01.338079 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4370f8-457d-4b93-910e-c23c1428979a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:01.338724 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4370f8-457d-4b93-910e-c23c1428979a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:01.339007 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4370f8-457d-4b93-910e-c23c1428979a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:01.339285 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4370f8-457d-4b93-910e-c23c1428979a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:01.349558 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4370f8-457d-4b93-910e-c23c1428979a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:01.351021 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4370f8-457d-4b93-910e-c23c1428979a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-4d4370f8-457d-4b93-910e-c23c1428979a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:01.365286 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:01.369104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:01.370117 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:01.370117 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:01.370117 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:01.370117 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 401/824] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:01.372648 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e55b41-9fcb-4ace-9b88-d353f4b91a3e None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:01.469265 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e55b41-9fcb-4ace-9b88-d353f4b91a3e None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:01.494890 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:01.503218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29dee0-dd21-4b2e-afaf-40cc9d3ad1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:01.505841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29dee0-dd21-4b2e-afaf-40cc9d3ad1c3 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:01.505841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29dee0-dd21-4b2e-afaf-40cc9d3ad1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:01.505841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29dee0-dd21-4b2e-afaf-40cc9d3ad1c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:01.505841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29dee0-dd21-4b2e-afaf-40cc9d3ad1c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:01.505841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29dee0-dd21-4b2e-afaf-40cc9d3ad1c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:01.507118 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29dee0-dd21-4b2e-afaf-40cc9d3ad1c3 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:01.518039 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 424/825] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:01.525578 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4370f8-457d-4b93-910e-c23c1428979a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:01.578883 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:01.625199 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4370f8-457d-4b93-910e-c23c1428979a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:01.658405 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f240ae-0f31-41da-af16-832be91bc25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:01.659020 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f240ae-0f31-41da-af16-832be91bc25e None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:01.659303 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f240ae-0f31-41da-af16-832be91bc25e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:01.659574 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f240ae-0f31-41da-af16-832be91bc25e None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:01.660346 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f240ae-0f31-41da-af16-832be91bc25e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:01.662395 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f240ae-0f31-41da-af16-832be91bc25e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:01.756119 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 402/826] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Aug 11 18:18:01 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:18:03.974132 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88b42f-a2d0-4f85-9732-d0c63d622fc0 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:03.974700 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88b42f-a2d0-4f85-9732-d0c63d622fc0 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:03.974700 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88b42f-a2d0-4f85-9732-d0c63d622fc0 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:03.976027 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 425/827] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:03.981317 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4bf07-36a8-4b2c-bcb8-eca61ca6554a None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:03.981701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4bf07-36a8-4b2c-bcb8-eca61ca6554a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:03.981867 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4bf07-36a8-4b2c-bcb8-eca61ca6554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:04.000796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-21c4bf07-36a8-4b2c-bcb8-eca61ca6554a None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:04.001902 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-21c4bf07-36a8-4b2c-bcb8-eca61ca6554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:04.068557 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 403/828] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:18:04.399104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88b42f-a2d0-4f85-9732-d0c63d622fc0 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:04.501958 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88b42f-a2d0-4f85-9732-d0c63d622fc0 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:04.536183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6468141-d902-4474-b42c-7c6b06dff9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:04.537006 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6468141-d902-4474-b42c-7c6b06dff9ff None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:04.537290 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6468141-d902-4474-b42c-7c6b06dff9ff None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:04.537579 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6468141-d902-4474-b42c-7c6b06dff9ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:04.548207 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6468141-d902-4474-b42c-7c6b06dff9ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-e6468141-d902-4474-b42c-7c6b06dff9ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:18:04.553032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:04.554235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:04.555332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 426/829] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:18:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:04.560485 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4bf07-36a8-4b2c-bcb8-eca61ca6554a None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:04.600549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:04.660001 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4bf07-36a8-4b2c-bcb8-eca61ca6554a None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:04.694422 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874118-18c4-4c2d-b1b1-94fb4c708b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:04.695074 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874118-18c4-4c2d-b1b1-94fb4c708b5f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:04.695352 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874118-18c4-4c2d-b1b1-94fb4c708b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:04.695623 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874118-18c4-4c2d-b1b1-94fb4c708b5f None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:04.696273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874118-18c4-4c2d-b1b1-94fb4c708b5f None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:04.696573 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874118-18c4-4c2d-b1b1-94fb4c708b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:04.697927 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874118-18c4-4c2d-b1b1-94fb4c708b5f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:04.705707 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 404/830] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:18:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:04.712444 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6468141-d902-4474-b42c-7c6b06dff9ff None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:04.759292 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:04.811255 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6468141-d902-4474-b42c-7c6b06dff9ff None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:04.844319 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7a5da-1896-4e5e-810f-3ba0b0008487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:04.844935 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7a5da-1896-4e5e-810f-3ba0b0008487 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:04.845280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7a5da-1896-4e5e-810f-3ba0b0008487 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:04.845555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7a5da-1896-4e5e-810f-3ba0b0008487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:04.855726 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7a5da-1896-4e5e-810f-3ba0b0008487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:04.857360 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7a5da-1896-4e5e-810f-3ba0b0008487 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-5ef7a5da-1896-4e5e-810f-3ba0b0008487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:04.872654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:04.873837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:04.874946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:04.874946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:04.874946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:04.874946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 427/831] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:04.880539 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874118-18c4-4c2d-b1b1-94fb4c708b5f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:04.978265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:04.981185 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874118-18c4-4c2d-b1b1-94fb4c708b5f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:05.014993 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f27af5-7d04-4017-8a00-47449a99e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:05.015666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f27af5-7d04-4017-8a00-47449a99e679 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:05.015984 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f27af5-7d04-4017-8a00-47449a99e679 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:05.016258 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f27af5-7d04-4017-8a00-47449a99e679 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:05.016889 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f27af5-7d04-4017-8a00-47449a99e679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:05.017198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f27af5-7d04-4017-8a00-47449a99e679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:05.018626 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f27af5-7d04-4017-8a00-47449a99e679 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:05.029779 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 405/832] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:18:05.035620 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7a5da-1896-4e5e-810f-3ba0b0008487 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:05.132626 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:05.136363 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7a5da-1896-4e5e-810f-3ba0b0008487 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:05.168431 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c677f-e34a-4b53-acd5-383ec521035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:05.169053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c677f-e34a-4b53-acd5-383ec521035f None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:05.169334 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c677f-e34a-4b53-acd5-383ec521035f None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:05.169626 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c677f-e34a-4b53-acd5-383ec521035f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:05.177582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c677f-e34a-4b53-acd5-383ec521035f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:05.179091 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c677f-e34a-4b53-acd5-383ec521035f None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-591c677f-e34a-4b53-acd5-383ec521035f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:18:05.189739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:05.190945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:05.193001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:05.193001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:05.193001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:18:05.193001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:18:05.193001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:18:05.193001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:18:05.193001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:18:05.193001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:18:05.193001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:05.193001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:05.194813 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 428/833] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:05.197199 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f27af5-7d04-4017-8a00-47449a99e679 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:05.296687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f27af5-7d04-4017-8a00-47449a99e679 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:05.330872 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea89d53-6e15-4fbc-9873-106f24b0a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:05.331460 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea89d53-6e15-4fbc-9873-106f24b0a08f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:05.331737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea89d53-6e15-4fbc-9873-106f24b0a08f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:05.332086 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea89d53-6e15-4fbc-9873-106f24b0a08f None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:05.332815 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea89d53-6e15-4fbc-9873-106f24b0a08f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:05.333119 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea89d53-6e15-4fbc-9873-106f24b0a08f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:05.334541 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea89d53-6e15-4fbc-9873-106f24b0a08f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:05.351719 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 406/834] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 11 18:18:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:05.357655 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c677f-e34a-4b53-acd5-383ec521035f None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:05.458260 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c677f-e34a-4b53-acd5-383ec521035f None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:05.492110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93f931-47f2-4bee-b22b-95942c865d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:05.492702 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93f931-47f2-4bee-b22b-95942c865d34 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:05.492982 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93f931-47f2-4bee-b22b-95942c865d34 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:05.493272 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93f931-47f2-4bee-b22b-95942c865d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:05.519282 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:05.559176 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93f931-47f2-4bee-b22b-95942c865d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:05.560535 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93f931-47f2-4bee-b22b-95942c865d34 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:05.660434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 429/835] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:18:05 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 18:18:05.666412 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea89d53-6e15-4fbc-9873-106f24b0a08f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:05.685456 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:05.765361 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea89d53-6e15-4fbc-9873-106f24b0a08f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:05.802069 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabbd3-e00a-4a56-8e6a-3b7f8210e251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:05.802701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabbd3-e00a-4a56-8e6a-3b7f8210e251 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:05.803031 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabbd3-e00a-4a56-8e6a-3b7f8210e251 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:05.803350 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabbd3-e00a-4a56-8e6a-3b7f8210e251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:05.813152 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dabbd3-e00a-4a56-8e6a-3b7f8210e251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:05.814529 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dabbd3-e00a-4a56-8e6a-3b7f8210e251 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-54dabbd3-e00a-4a56-8e6a-3b7f8210e251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:05.829234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:05.833132 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:05.834225 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:05.834225 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:05.834225 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:05.834225 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 407/836] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:05.837224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93f931-47f2-4bee-b22b-95942c865d34 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:05.896592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:05.936302 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93f931-47f2-4bee-b22b-95942c865d34 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:05.970053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffae41-5e35-44e0-b03e-ea0e3ecb39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:05.970652 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffae41-5e35-44e0-b03e-ea0e3ecb39c8 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:05.970961 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffae41-5e35-44e0-b03e-ea0e3ecb39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:05.971236 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffae41-5e35-44e0-b03e-ea0e3ecb39c8 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:05.971885 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffae41-5e35-44e0-b03e-ea0e3ecb39c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:05.972169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffae41-5e35-44e0-b03e-ea0e3ecb39c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:05.974234 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffae41-5e35-44e0-b03e-ea0e3ecb39c8 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:05.985264 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 430/837] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:05.991354 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabbd3-e00a-4a56-8e6a-3b7f8210e251 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:06.061235 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:06.092071 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabbd3-e00a-4a56-8e6a-3b7f8210e251 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:06.124262 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af711c-dce1-4b06-99d9-0a770908a94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:06.124921 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af711c-dce1-4b06-99d9-0a770908a94b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:06.125197 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af711c-dce1-4b06-99d9-0a770908a94b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:06.125465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af711c-dce1-4b06-99d9-0a770908a94b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:06.132568 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af711c-dce1-4b06-99d9-0a770908a94b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:06.135772 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af711c-dce1-4b06-99d9-0a770908a94b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-e4af711c-dce1-4b06-99d9-0a770908a94b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:18:06.145674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:06.146740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:06.148309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:18:06.148309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:18:06.148309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:18:06.148309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:18:06.148309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:18:06.148309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:18:06.148309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:06.148309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:06.148309 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 408/838] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:06.153265 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffae41-5e35-44e0-b03e-ea0e3ecb39c8 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:06.255955 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffae41-5e35-44e0-b03e-ea0e3ecb39c8 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:06.272885 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:06.288713 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00db9cd-86ce-4f9b-bc68-6998e61cb60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:06.289305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00db9cd-86ce-4f9b-bc68-6998e61cb60f None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:06.289580 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00db9cd-86ce-4f9b-bc68-6998e61cb60f None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:06.289846 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00db9cd-86ce-4f9b-bc68-6998e61cb60f None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:06.290549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00db9cd-86ce-4f9b-bc68-6998e61cb60f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:06.290930 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00db9cd-86ce-4f9b-bc68-6998e61cb60f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:06.292333 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00db9cd-86ce-4f9b-bc68-6998e61cb60f None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:06.303866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 431/839] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:06.309924 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af711c-dce1-4b06-99d9-0a770908a94b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:06.409207 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af711c-dce1-4b06-99d9-0a770908a94b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:06.438349 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:06.444348 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ece33-6056-4e42-b8ff-5789c1521bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:06.444944 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ece33-6056-4e42-b8ff-5789c1521bce None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:06.445277 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ece33-6056-4e42-b8ff-5789c1521bce None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:06.445556 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ece33-6056-4e42-b8ff-5789c1521bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:06.446271 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ece33-6056-4e42-b8ff-5789c1521bce None admin] RBAC: Adding query filter params (role.id=762ed046c04e4a16ade8c5e989710fa2, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=3b58fad7b1e14a5f8c492a76a8840d44) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:06.446577 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ece33-6056-4e42-b8ff-5789c1521bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:06.448029 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ece33-6056-4e42-b8ff-5789c1521bce None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:06.453203 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 409/840] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:18:06 2022] GET /identity/v3/role_assignments?user.id=3b58fad7b1e14a5f8c492a76a8840d44&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=762ed046c04e4a16ade8c5e989710fa2 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:08.621813 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46c487-d28d-4949-b238-73ea62bf4368 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:08.622411 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46c487-d28d-4949-b238-73ea62bf4368 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:08.622411 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46c487-d28d-4949-b238-73ea62bf4368 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:08.623767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 432/841] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:08.629301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c25751-6e60-4866-b919-e3a097c431bb None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:08.629747 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c25751-6e60-4866-b919-e3a097c431bb None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:08.629858 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c25751-6e60-4866-b919-e3a097c431bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:08.647873 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-74c25751-6e60-4866-b919-e3a097c431bb None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:08.649077 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-74c25751-6e60-4866-b919-e3a097c431bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:08.715413 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 410/842] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:08 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:18:09.047256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46c487-d28d-4949-b238-73ea62bf4368 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:09.146815 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46c487-d28d-4949-b238-73ea62bf4368 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:09.179417 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21023feb-6090-4752-a265-f6d1fea027e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:09.180012 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21023feb-6090-4752-a265-f6d1fea027e2 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:09.180289 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21023feb-6090-4752-a265-f6d1fea027e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:09.180554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21023feb-6090-4752-a265-f6d1fea027e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:09.190221 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21023feb-6090-4752-a265-f6d1fea027e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-21023feb-6090-4752-a265-f6d1fea027e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:18:09.195530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:09.196664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:09.198003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 433/843] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:18:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:09.202508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c25751-6e60-4866-b919-e3a097c431bb None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:09.304119 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c25751-6e60-4866-b919-e3a097c431bb None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:09.326540 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:09.337124 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb07f3f-f8e3-4f26-85a8-592018597391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:09.337724 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07f3f-f8e3-4f26-85a8-592018597391 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:09.338005 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07f3f-f8e3-4f26-85a8-592018597391 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:09.338278 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07f3f-f8e3-4f26-85a8-592018597391 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:09.338974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb07f3f-f8e3-4f26-85a8-592018597391 None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:09.339277 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb07f3f-f8e3-4f26-85a8-592018597391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:09.340671 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb07f3f-f8e3-4f26-85a8-592018597391 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:09.348834 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 411/844] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:18:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:09.354555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21023feb-6090-4752-a265-f6d1fea027e2 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:09.395482 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:09.453633 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21023feb-6090-4752-a265-f6d1fea027e2 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:09.487073 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e792c-13db-47a5-be83-d3e6d8e13ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:09.487739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e792c-13db-47a5-be83-d3e6d8e13ffe None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:09.488179 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e792c-13db-47a5-be83-d3e6d8e13ffe None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:09.488459 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e792c-13db-47a5-be83-d3e6d8e13ffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:09.498309 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e792c-13db-47a5-be83-d3e6d8e13ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:09.499779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e792c-13db-47a5-be83-d3e6d8e13ffe None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-2f4e792c-13db-47a5-be83-d3e6d8e13ffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:09.513854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:09.514987 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:09.516186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:09.516186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:09.516186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:09.516186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 434/845] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:09.521374 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb07f3f-f8e3-4f26-85a8-592018597391 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:09.621434 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb07f3f-f8e3-4f26-85a8-592018597391 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:09.654269 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0319-9974-46f4-b3bb-3567ec0f0c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:09.654898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0319-9974-46f4-b3bb-3567ec0f0c08 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:09.655165 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0319-9974-46f4-b3bb-3567ec0f0c08 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:09.655439 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0319-9974-46f4-b3bb-3567ec0f0c08 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:09.656065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a0319-9974-46f4-b3bb-3567ec0f0c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:09.656367 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a0319-9974-46f4-b3bb-3567ec0f0c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:09.657718 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a0319-9974-46f4-b3bb-3567ec0f0c08 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:09.670147 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 412/846] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:09.676525 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e792c-13db-47a5-be83-d3e6d8e13ffe None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:09.767877 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:09.777737 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e792c-13db-47a5-be83-d3e6d8e13ffe None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:09.810285 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3870f-eb25-492e-9839-8d717e906b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:09.810926 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3870f-eb25-492e-9839-8d717e906b05 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:09.811208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3870f-eb25-492e-9839-8d717e906b05 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:09.811481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3870f-eb25-492e-9839-8d717e906b05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:09.820041 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3870f-eb25-492e-9839-8d717e906b05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:09.821462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3870f-eb25-492e-9839-8d717e906b05 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-ecf3870f-eb25-492e-9839-8d717e906b05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:18:09.833296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:09.834508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:09.835501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 435/847] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:09.840381 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0319-9974-46f4-b3bb-3567ec0f0c08 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:09.888414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:09.943744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0319-9974-46f4-b3bb-3567ec0f0c08 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:09.976699 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336abde3-d871-4574-afda-c99e33bce267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:09.977294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336abde3-d871-4574-afda-c99e33bce267 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:09.977572 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336abde3-d871-4574-afda-c99e33bce267 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:09.977845 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336abde3-d871-4574-afda-c99e33bce267 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:09.978557 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336abde3-d871-4574-afda-c99e33bce267 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:09.978888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336abde3-d871-4574-afda-c99e33bce267 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:09.980300 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336abde3-d871-4574-afda-c99e33bce267 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:09.997853 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 413/848] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 11 18:18:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:10.004714 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3870f-eb25-492e-9839-8d717e906b05 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:10.112260 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3870f-eb25-492e-9839-8d717e906b05 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:10.147188 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f021d61-fc8a-4908-95d0-ab23085f9eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:10.147789 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f021d61-fc8a-4908-95d0-ab23085f9eed None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:10.148073 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f021d61-fc8a-4908-95d0-ab23085f9eed None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:10.148345 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f021d61-fc8a-4908-95d0-ab23085f9eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:10.158775 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f021d61-fc8a-4908-95d0-ab23085f9eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:10.160277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f021d61-fc8a-4908-95d0-ab23085f9eed None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-7f021d61-fc8a-4908-95d0-ab23085f9eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:10.174277 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:10.175942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:10.176902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:10.176902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:10.176902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:10.176902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 436/849] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:10.182198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336abde3-d871-4574-afda-c99e33bce267 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:10.282587 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336abde3-d871-4574-afda-c99e33bce267 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:10.284985 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:10.316629 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d3acb-14b0-43f5-ac32-3929f53ee0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:10.317227 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d3acb-14b0-43f5-ac32-3929f53ee0d1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:10.317512 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d3acb-14b0-43f5-ac32-3929f53ee0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:10.317782 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d3acb-14b0-43f5-ac32-3929f53ee0d1 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:10.318406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d3acb-14b0-43f5-ac32-3929f53ee0d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:10.318740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d3acb-14b0-43f5-ac32-3929f53ee0d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:10.320138 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d3acb-14b0-43f5-ac32-3929f53ee0d1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:10.331194 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 414/850] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:10.337116 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f021d61-fc8a-4908-95d0-ab23085f9eed None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:10.340043 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:10.437799 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f021d61-fc8a-4908-95d0-ab23085f9eed None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:10.471747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a4a6d-16cb-4323-92df-3da828c36591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:10.472902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a4a6d-16cb-4323-92df-3da828c36591 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:10.473242 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a4a6d-16cb-4323-92df-3da828c36591 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:10.473506 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a4a6d-16cb-4323-92df-3da828c36591 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:10.480230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a4a6d-16cb-4323-92df-3da828c36591 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:10.481710 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a4a6d-16cb-4323-92df-3da828c36591 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-ed0a4a6d-16cb-4323-92df-3da828c36591 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:18:10.495434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:10.496555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:10.497670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:18:10.497670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:18:10.497670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:18:10.497670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:18:10.497670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:18:10.497670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:18:10.497670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:10.497670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:10.497670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 437/851] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:10.502533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d3acb-14b0-43f5-ac32-3929f53ee0d1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:10.603648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d3acb-14b0-43f5-ac32-3929f53ee0d1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:10.637415 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e83ba3-4d5c-4da9-bcb3-7f5c224311bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:10.638009 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e83ba3-4d5c-4da9-bcb3-7f5c224311bd None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:10.638291 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e83ba3-4d5c-4da9-bcb3-7f5c224311bd None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:10.638567 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e83ba3-4d5c-4da9-bcb3-7f5c224311bd None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:10.639402 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e83ba3-4d5c-4da9-bcb3-7f5c224311bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:10.639712 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e83ba3-4d5c-4da9-bcb3-7f5c224311bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:10.641156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e83ba3-4d5c-4da9-bcb3-7f5c224311bd None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:10.653911 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 415/852] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:10.660433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a4a6d-16cb-4323-92df-3da828c36591 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:10.719706 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:10.759650 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a4a6d-16cb-4323-92df-3da828c36591 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:10.793205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8a806-dcd7-4b21-8630-6a4454513c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:10.793892 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8a806-dcd7-4b21-8630-6a4454513c01 None admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:10.794175 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8a806-dcd7-4b21-8630-6a4454513c01 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:10.794452 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8a806-dcd7-4b21-8630-6a4454513c01 None admin] PATH_INFO: `/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/3b58fad7b1e14a5f8c492a76a8840d44/roles/762ed046c04e4a16ade8c5e989710fa2` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:10.809063 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8a806-dcd7-4b21-8630-6a4454513c01 None admin] RBAC: Authorizing `identity:create_grant(project_id=a930d08c2f31471bbe6a66f5c626d22f, user_id=3b58fad7b1e14a5f8c492a76a8840d44, role_id=762ed046c04e4a16ade8c5e989710fa2)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:10.810514 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8a806-dcd7-4b21-8630-6a4454513c01 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:10.886282 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 438/853] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:18:10 2022] PUT /identity/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/3b58fad7b1e14a5f8c492a76a8840d44/roles/762ed046c04e4a16ade8c5e989710fa2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:18:13.027828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385d2a-c368-4e59-9b38-44282eaf0ef5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:13.028332 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385d2a-c368-4e59-9b38-44282eaf0ef5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:13.028332 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb385d2a-c368-4e59-9b38-44282eaf0ef5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:13.029670 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 416/854] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:13.034962 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e2433-c238-410b-ac40-97d6ef268b49 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:13.035404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e2433-c238-410b-ac40-97d6ef268b49 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:13.035689 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e2433-c238-410b-ac40-97d6ef268b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:13.053410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-8d1e2433-c238-410b-ac40-97d6ef268b49 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:13.054631 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-8d1e2433-c238-410b-ac40-97d6ef268b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:13.120633 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 439/855] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:13 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:18:13.457171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb385d2a-c368-4e59-9b38-44282eaf0ef5 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:13.483115 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:13.558533 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb385d2a-c368-4e59-9b38-44282eaf0ef5 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:13.593001 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886a2e-112c-4d30-b996-dfc4d1f32fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:13.593646 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886a2e-112c-4d30-b996-dfc4d1f32fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:13.593959 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886a2e-112c-4d30-b996-dfc4d1f32fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:13.594237 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886a2e-112c-4d30-b996-dfc4d1f32fd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:13.604469 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886a2e-112c-4d30-b996-dfc4d1f32fd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-a0886a2e-112c-4d30-b996-dfc4d1f32fd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:18:13.609183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:13.610328 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:13.611255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 417/856] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Aug 11 18:18:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:13.616994 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e2433-c238-410b-ac40-97d6ef268b49 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:13.659712 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:13.715804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e2433-c238-410b-ac40-97d6ef268b49 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:13.749712 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079af3d-78de-4d98-98db-e8fd960866fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:13.750311 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079af3d-78de-4d98-98db-e8fd960866fc None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:13.750591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079af3d-78de-4d98-98db-e8fd960866fc None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:13.750892 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079af3d-78de-4d98-98db-e8fd960866fc None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:13.751547 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079af3d-78de-4d98-98db-e8fd960866fc None admin] RBAC: Adding query filter params (name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:13.751849 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079af3d-78de-4d98-98db-e8fd960866fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:13.753203 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079af3d-78de-4d98-98db-e8fd960866fc None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:13.761402 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 440/857] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Aug 11 18:18:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:13.767469 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886a2e-112c-4d30-b996-dfc4d1f32fd9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:13.853117 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:13.869032 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886a2e-112c-4d30-b996-dfc4d1f32fd9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:13.903274 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd69a2-01e1-40a6-878a-bdca538e7d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:13.903887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd69a2-01e1-40a6-878a-bdca538e7d11 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:13.904164 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd69a2-01e1-40a6-878a-bdca538e7d11 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:13.904436 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd69a2-01e1-40a6-878a-bdca538e7d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:13.914301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd69a2-01e1-40a6-878a-bdca538e7d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:13.915787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd69a2-01e1-40a6-878a-bdca538e7d11 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-0afd69a2-01e1-40a6-878a-bdca538e7d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:13.930622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:13.932424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:13.934131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:13.934131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:13.934131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:13.934131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 418/858] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:13.937595 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079af3d-78de-4d98-98db-e8fd960866fc None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:14.039961 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079af3d-78de-4d98-98db-e8fd960866fc None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:14.042337 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:14.073742 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b5761-365a-4378-aaa1-24bc4933f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:14.074337 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b5761-365a-4378-aaa1-24bc4933f266 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:14.074641 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b5761-365a-4378-aaa1-24bc4933f266 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:14.074951 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b5761-365a-4378-aaa1-24bc4933f266 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:14.075586 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b5761-365a-4378-aaa1-24bc4933f266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:14.075889 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b5761-365a-4378-aaa1-24bc4933f266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:14.077246 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b5761-365a-4378-aaa1-24bc4933f266 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:14.088654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 441/859] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:14.094344 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd69a2-01e1-40a6-878a-bdca538e7d11 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:14.195575 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd69a2-01e1-40a6-878a-bdca538e7d11 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:14.228232 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ada938-f289-40ca-8541-b83a229966ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:14.228861 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ada938-f289-40ca-8541-b83a229966ae None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:14.229142 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ada938-f289-40ca-8541-b83a229966ae None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:14.229417 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ada938-f289-40ca-8541-b83a229966ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:14.232069 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:14.236955 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ada938-f289-40ca-8541-b83a229966ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:14.238908 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ada938-f289-40ca-8541-b83a229966ae None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-07ada938-f289-40ca-8541-b83a229966ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:18:14.250003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:14.251214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:14.252520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 419/860] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:14.257773 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b5761-365a-4378-aaa1-24bc4933f266 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:14.357974 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b5761-365a-4378-aaa1-24bc4933f266 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:14.392473 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11ad5-b928-4b51-9c94-8e12c45d3fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:14.393067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11ad5-b928-4b51-9c94-8e12c45d3fa9 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:14.399971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11ad5-b928-4b51-9c94-8e12c45d3fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:14.399971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a11ad5-b928-4b51-9c94-8e12c45d3fa9 None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:14.399971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a11ad5-b928-4b51-9c94-8e12c45d3fa9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:14.399971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a11ad5-b928-4b51-9c94-8e12c45d3fa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:14.399971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a11ad5-b928-4b51-9c94-8e12c45d3fa9 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:14.412995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 442/861] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 11 18:18:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:14.418752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ada938-f289-40ca-8541-b83a229966ae None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:14.517310 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ada938-f289-40ca-8541-b83a229966ae None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:14.550833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f17cf6-5d16-48c8-9ed4-8d4374c3c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:14.551476 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f17cf6-5d16-48c8-9ed4-8d4374c3c10b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:14.551755 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f17cf6-5d16-48c8-9ed4-8d4374c3c10b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:14.552023 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f17cf6-5d16-48c8-9ed4-8d4374c3c10b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:14.613369 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:14.620342 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f17cf6-5d16-48c8-9ed4-8d4374c3c10b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:14.621821 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f17cf6-5d16-48c8-9ed4-8d4374c3c10b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:14.717759 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 420/862] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:18:14 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 18:18:14.724436 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11ad5-b928-4b51-9c94-8e12c45d3fa9 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:14.749104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:14.823366 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a11ad5-b928-4b51-9c94-8e12c45d3fa9 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:14.857268 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c5052-2bad-484b-8aad-1028b20fd03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:14.857884 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c5052-2bad-484b-8aad-1028b20fd03b None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:14.858159 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c5052-2bad-484b-8aad-1028b20fd03b None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:14.858431 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c5052-2bad-484b-8aad-1028b20fd03b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:14.868548 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c5052-2bad-484b-8aad-1028b20fd03b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:14.869918 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c5052-2bad-484b-8aad-1028b20fd03b None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-f55c5052-2bad-484b-8aad-1028b20fd03b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:14.884018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:14.885110 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:14.886189 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:14.886189 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:14.886189 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:14.886189 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 443/863] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:14.890813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f17cf6-5d16-48c8-9ed4-8d4374c3c10b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:14.984214 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:14.990322 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f17cf6-5d16-48c8-9ed4-8d4374c3c10b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:15.023296 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ab04-b92a-4285-8c06-b2cd0f82bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:15.023898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ab04-b92a-4285-8c06-b2cd0f82bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:15.024183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ab04-b92a-4285-8c06-b2cd0f82bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:15.024534 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ab04-b92a-4285-8c06-b2cd0f82bfc5 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:15.025211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ab04-b92a-4285-8c06-b2cd0f82bfc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:15.025542 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ab04-b92a-4285-8c06-b2cd0f82bfc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:15.026939 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ab04-b92a-4285-8c06-b2cd0f82bfc5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:15.039368 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 421/864] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:15.045281 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c5052-2bad-484b-8aad-1028b20fd03b None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:15.118299 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:15.142716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c5052-2bad-484b-8aad-1028b20fd03b None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:15.177943 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bf842-3876-4b42-a7bf-895997f12536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:15.178553 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bf842-3876-4b42-a7bf-895997f12536 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:15.178858 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bf842-3876-4b42-a7bf-895997f12536 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:15.179128 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bf842-3876-4b42-a7bf-895997f12536 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:15.185528 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bf842-3876-4b42-a7bf-895997f12536 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:15.186983 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bf842-3876-4b42-a7bf-895997f12536 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-9b0bf842-3876-4b42-a7bf-895997f12536 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:18:15.198555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:15.200663 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:15.201680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:18:15.201680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:18:15.201680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:18:15.201680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:18:15.201680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:18:15.201680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:18:15.201680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:15.201680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:15.201680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 444/865] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:18:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:18:15.205648 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ab04-b92a-4285-8c06-b2cd0f82bfc5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:15.307605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ab04-b92a-4285-8c06-b2cd0f82bfc5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:15.342836 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57375ff0-e05c-4aad-a58f-ee240dd2fddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:15.343431 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57375ff0-e05c-4aad-a58f-ee240dd2fddd None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:15.343712 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57375ff0-e05c-4aad-a58f-ee240dd2fddd None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:15.343980 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57375ff0-e05c-4aad-a58f-ee240dd2fddd None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:15.344655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57375ff0-e05c-4aad-a58f-ee240dd2fddd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:15.344957 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57375ff0-e05c-4aad-a58f-ee240dd2fddd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:15.346367 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57375ff0-e05c-4aad-a58f-ee240dd2fddd None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:15.358426 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 422/866] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:18:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:15.364831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bf842-3876-4b42-a7bf-895997f12536 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:15.463234 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bf842-3876-4b42-a7bf-895997f12536 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:15.496092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c9eb0-1ef5-4329-a1b2-14c0eda93bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:15.496682 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c9eb0-1ef5-4329-a1b2-14c0eda93bae None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:15.496967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c9eb0-1ef5-4329-a1b2-14c0eda93bae None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:15.497245 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c9eb0-1ef5-4329-a1b2-14c0eda93bae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:15.497984 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c9eb0-1ef5-4329-a1b2-14c0eda93bae None admin] RBAC: Adding query filter params (role.id=762ed046c04e4a16ade8c5e989710fa2, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=3b58fad7b1e14a5f8c492a76a8840d44) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:15.498296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c9eb0-1ef5-4329-a1b2-14c0eda93bae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:15.499759 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c9eb0-1ef5-4329-a1b2-14c0eda93bae None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:15.501463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:15.506378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 445/867] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:18:15 2022] GET /identity/v3/role_assignments?user.id=3b58fad7b1e14a5f8c492a76a8840d44&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=762ed046c04e4a16ade8c5e989710fa2 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:17.734841 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e03b6-a431-4af7-b941-fb93b3c1b411 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:17.735393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e03b6-a431-4af7-b941-fb93b3c1b411 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:17.735497 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e03b6-a431-4af7-b941-fb93b3c1b411 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:17.736772 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 423/868] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:17.742856 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056173-d25e-4fd9-90db-5f311b754577 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:17.743280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056173-d25e-4fd9-90db-5f311b754577 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:17.747906 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056173-d25e-4fd9-90db-5f311b754577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:17.761791 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-44056173-d25e-4fd9-90db-5f311b754577 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:17.763045 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-44056173-d25e-4fd9-90db-5f311b754577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:17.829676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 446/869] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:17 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:18:18.161564 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e03b6-a431-4af7-b941-fb93b3c1b411 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:18.179898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:18.262774 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e03b6-a431-4af7-b941-fb93b3c1b411 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:18.296247 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d375d-b4d3-41af-ac18-893ce0e81d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:18.296866 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d375d-b4d3-41af-ac18-893ce0e81d73 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:18.297142 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d375d-b4d3-41af-ac18-893ce0e81d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:18.297412 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d375d-b4d3-41af-ac18-893ce0e81d73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:18.307494 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d375d-b4d3-41af-ac18-893ce0e81d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-930d375d-b4d3-41af-ac18-893ce0e81d73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:18:18.312108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:18.313195 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:18.314414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 424/870] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:18:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:18.320096 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44056173-d25e-4fd9-90db-5f311b754577 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:18.420256 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44056173-d25e-4fd9-90db-5f311b754577 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:18.447260 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:18.454735 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a0d79-e8b0-4b69-b76a-79ac5503d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:18.455338 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a0d79-e8b0-4b69-b76a-79ac5503d4fc None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:18.455616 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a0d79-e8b0-4b69-b76a-79ac5503d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:18.455887 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a0d79-e8b0-4b69-b76a-79ac5503d4fc None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:18.456787 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a0d79-e8b0-4b69-b76a-79ac5503d4fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:18.457095 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a0d79-e8b0-4b69-b76a-79ac5503d4fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:18.458454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a0d79-e8b0-4b69-b76a-79ac5503d4fc None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:18.466226 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 447/871] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:18:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:18.472332 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d375d-b4d3-41af-ac18-893ce0e81d73 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:18.551826 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:18.574605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d375d-b4d3-41af-ac18-893ce0e81d73 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:18.608830 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fcdd7-4a3a-4b29-b5b6-4048b9d3b8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:18.609444 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fcdd7-4a3a-4b29-b5b6-4048b9d3b8f7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:18.609722 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fcdd7-4a3a-4b29-b5b6-4048b9d3b8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:18.609993 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fcdd7-4a3a-4b29-b5b6-4048b9d3b8f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:18.620616 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fcdd7-4a3a-4b29-b5b6-4048b9d3b8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:18.622061 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fcdd7-4a3a-4b29-b5b6-4048b9d3b8f7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-221fcdd7-4a3a-4b29-b5b6-4048b9d3b8f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:18.637000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:18.642447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:18.643694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:18.643694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:18.643694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:18.643694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 425/872] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:18.644348 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a0d79-e8b0-4b69-b76a-79ac5503d4fc None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:18.741606 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a0d79-e8b0-4b69-b76a-79ac5503d4fc None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:18.774708 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9da435-b7f5-4847-be6d-f1e45723043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:18.775321 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9da435-b7f5-4847-be6d-f1e45723043e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:18.775601 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9da435-b7f5-4847-be6d-f1e45723043e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:18.775874 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9da435-b7f5-4847-be6d-f1e45723043e None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:18.776550 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9da435-b7f5-4847-be6d-f1e45723043e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:18.776846 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9da435-b7f5-4847-be6d-f1e45723043e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:18.778196 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9da435-b7f5-4847-be6d-f1e45723043e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:18.790094 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 448/873] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:18.795835 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fcdd7-4a3a-4b29-b5b6-4048b9d3b8f7 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:18.895570 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fcdd7-4a3a-4b29-b5b6-4048b9d3b8f7 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:18.922238 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:18.931073 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b2dde-34db-4c5f-a3fc-df8b0de4ba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:18.931687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b2dde-34db-4c5f-a3fc-df8b0de4ba04 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:18.931963 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b2dde-34db-4c5f-a3fc-df8b0de4ba04 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:18.932231 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b2dde-34db-4c5f-a3fc-df8b0de4ba04 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:18.939461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b2dde-34db-4c5f-a3fc-df8b0de4ba04 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:18.941474 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b2dde-34db-4c5f-a3fc-df8b0de4ba04 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-9d8b2dde-34db-4c5f-a3fc-df8b0de4ba04 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:18:18.952279 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:18.959590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:18.960553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 426/874] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:18.961167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9da435-b7f5-4847-be6d-f1e45723043e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:19.016228 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:19.060814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9da435-b7f5-4847-be6d-f1e45723043e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:19.095403 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad7fc7-b379-4141-b26f-e353894cdaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:19.096097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad7fc7-b379-4141-b26f-e353894cdaf4 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:19.096375 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad7fc7-b379-4141-b26f-e353894cdaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:19.096645 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad7fc7-b379-4141-b26f-e353894cdaf4 None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:19.098331 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad7fc7-b379-4141-b26f-e353894cdaf4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:19.098634 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad7fc7-b379-4141-b26f-e353894cdaf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:19.100222 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad7fc7-b379-4141-b26f-e353894cdaf4 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:19.117850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 449/875] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 11 18:18:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:19.123765 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b2dde-34db-4c5f-a3fc-df8b0de4ba04 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:19.224754 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b2dde-34db-4c5f-a3fc-df8b0de4ba04 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:19.258441 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb6b43-be1f-4bf5-bcd6-ee34d3101bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:19.259085 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb6b43-be1f-4bf5-bcd6-ee34d3101bd8 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:19.259363 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb6b43-be1f-4bf5-bcd6-ee34d3101bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:19.259632 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb6b43-be1f-4bf5-bcd6-ee34d3101bd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:19.313509 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:19.325802 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb6b43-be1f-4bf5-bcd6-ee34d3101bd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:19.327289 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb6b43-be1f-4bf5-bcd6-ee34d3101bd8 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:19.428374 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 427/876] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:18:19 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 18:18:19.434230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad7fc7-b379-4141-b26f-e353894cdaf4 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:19.533702 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad7fc7-b379-4141-b26f-e353894cdaf4 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:19.544164 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:19.568841 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc158fa-7240-49db-bb09-5eb5305ea0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:19.569393 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc158fa-7240-49db-bb09-5eb5305ea0dd None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:19.569673 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc158fa-7240-49db-bb09-5eb5305ea0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:19.569946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc158fa-7240-49db-bb09-5eb5305ea0dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:19.579676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc158fa-7240-49db-bb09-5eb5305ea0dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:19.581181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc158fa-7240-49db-bb09-5eb5305ea0dd None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-1bc158fa-7240-49db-bb09-5eb5305ea0dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:19.595683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:19.596790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:19.597928 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:19.597928 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:19.597928 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:19.597928 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 450/877] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:19.603088 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb6b43-be1f-4bf5-bcd6-ee34d3101bd8 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:19.689126 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:19.701726 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb6b43-be1f-4bf5-bcd6-ee34d3101bd8 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:19.734886 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf1a9e-4090-45c2-82b3-fd93a70304c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:19.735491 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf1a9e-4090-45c2-82b3-fd93a70304c1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:19.735773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf1a9e-4090-45c2-82b3-fd93a70304c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:19.736043 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf1a9e-4090-45c2-82b3-fd93a70304c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:19.736675 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf1a9e-4090-45c2-82b3-fd93a70304c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:19.736997 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf1a9e-4090-45c2-82b3-fd93a70304c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:19.738416 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf1a9e-4090-45c2-82b3-fd93a70304c1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:19.750001 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 428/878] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:19.756492 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc158fa-7240-49db-bb09-5eb5305ea0dd None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:19.856968 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc158fa-7240-49db-bb09-5eb5305ea0dd None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:19.890626 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3510405-ddbe-45da-82f9-dc6b2a5ab67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:19.891272 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510405-ddbe-45da-82f9-dc6b2a5ab67e None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:19.891551 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510405-ddbe-45da-82f9-dc6b2a5ab67e None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:19.891821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510405-ddbe-45da-82f9-dc6b2a5ab67e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:19.898306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3510405-ddbe-45da-82f9-dc6b2a5ab67e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:19.899764 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3510405-ddbe-45da-82f9-dc6b2a5ab67e None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-e3510405-ddbe-45da-82f9-dc6b2a5ab67e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:18:19.911148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:19.912270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:19.913573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:18:19.913573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:18:19.913573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:18:19.913573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:18:19.913573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:18:19.913573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:18:19.913573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:19.913573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:19.913573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 451/879] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:18:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:19.918170 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf1a9e-4090-45c2-82b3-fd93a70304c1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:20.018159 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf1a9e-4090-45c2-82b3-fd93a70304c1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:20.052755 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6de534-e410-42aa-935c-f634b0b27add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:20.053459 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6de534-e410-42aa-935c-f634b0b27add None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:20.053733 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6de534-e410-42aa-935c-f634b0b27add None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:20.054001 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6de534-e410-42aa-935c-f634b0b27add None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:20.054700 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6de534-e410-42aa-935c-f634b0b27add None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:20.055003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6de534-e410-42aa-935c-f634b0b27add None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:20.056580 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6de534-e410-42aa-935c-f634b0b27add None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:20.068929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 429/880] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:18:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:20.074958 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3510405-ddbe-45da-82f9-dc6b2a5ab67e None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:20.097922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:20.172572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3510405-ddbe-45da-82f9-dc6b2a5ab67e None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:20.205242 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e4ed2-c0a2-42b0-b1cf-2c9fec9522b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:20.205830 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4ed2-c0a2-42b0-b1cf-2c9fec9522b7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:20.206777 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4ed2-c0a2-42b0-b1cf-2c9fec9522b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:20.207020 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4ed2-c0a2-42b0-b1cf-2c9fec9522b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:20.207846 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e4ed2-c0a2-42b0-b1cf-2c9fec9522b7 None admin] RBAC: Adding query filter params (role.id=f89efd1f713043d8835c127de30f53ca, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=3b58fad7b1e14a5f8c492a76a8840d44) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:20.208158 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e4ed2-c0a2-42b0-b1cf-2c9fec9522b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:20.209583 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e4ed2-c0a2-42b0-b1cf-2c9fec9522b7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:20.214852 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 452/881] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:18:20 2022] GET /identity/v3/role_assignments?user.id=3b58fad7b1e14a5f8c492a76a8840d44&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=f89efd1f713043d8835c127de30f53ca => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:22.375375 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0a21-4987-46ce-ad25-5f644299c71b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:22.375905 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0a21-4987-46ce-ad25-5f644299c71b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:22.375905 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0a21-4987-46ce-ad25-5f644299c71b None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:22.377257 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 430/882] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:22.382575 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4c45-aeb1-4954-825a-8ea63b9c953f None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:22.383001 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4c45-aeb1-4954-825a-8ea63b9c953f None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:22.383158 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af4c45-aeb1-4954-825a-8ea63b9c953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:22.401331 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-49af4c45-aeb1-4954-825a-8ea63b9c953f None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:22.402521 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-49af4c45-aeb1-4954-825a-8ea63b9c953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:22.468561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 453/883] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:22 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:18:22.794380 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0a21-4987-46ce-ad25-5f644299c71b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:22.805445 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:22.893293 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0a21-4987-46ce-ad25-5f644299c71b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:22.929026 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2f628-3365-4e69-b871-7e68fd40746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:22.929646 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2f628-3365-4e69-b871-7e68fd40746e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:22.929928 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2f628-3365-4e69-b871-7e68fd40746e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:22.930205 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2f628-3365-4e69-b871-7e68fd40746e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:22.940031 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2f628-3365-4e69-b871-7e68fd40746e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-58f2f628-3365-4e69-b871-7e68fd40746e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:18:22.945432 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:22.946527 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:22.947825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 431/884] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:22.952543 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4c45-aeb1-4954-825a-8ea63b9c953f None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:22.967540 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:23.048555 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af4c45-aeb1-4954-825a-8ea63b9c953f None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:23.090222 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc67b99-05b7-4868-bee0-d384d388622a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:23.090851 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67b99-05b7-4868-bee0-d384d388622a None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:23.091128 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67b99-05b7-4868-bee0-d384d388622a None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:23.091398 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67b99-05b7-4868-bee0-d384d388622a None admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:23.092056 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc67b99-05b7-4868-bee0-d384d388622a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:23.092355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc67b99-05b7-4868-bee0-d384d388622a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:23.093714 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc67b99-05b7-4868-bee0-d384d388622a None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:23.101881 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 454/885] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:23.107828 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2f628-3365-4e69-b871-7e68fd40746e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:23.176058 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:23.208439 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2f628-3365-4e69-b871-7e68fd40746e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:23.242769 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b043a9-9479-4e94-9e34-9bbf6f410c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:23.243395 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b043a9-9479-4e94-9e34-9bbf6f410c43 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:23.243670 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b043a9-9479-4e94-9e34-9bbf6f410c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:23.243938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b043a9-9479-4e94-9e34-9bbf6f410c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:23.254858 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b043a9-9479-4e94-9e34-9bbf6f410c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:23.256494 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b043a9-9479-4e94-9e34-9bbf6f410c43 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-51b043a9-9479-4e94-9e34-9bbf6f410c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:23.271511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:23.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:23.273572 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:23.273572 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:23.273572 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:23.273572 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 432/886] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:23.278726 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc67b99-05b7-4868-bee0-d384d388622a None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:23.354378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:23.378207 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc67b99-05b7-4868-bee0-d384d388622a None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:23.410970 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28b863-8889-44e6-86ec-e5dbcc7a6414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:23.411572 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b863-8889-44e6-86ec-e5dbcc7a6414 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:23.411853 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b863-8889-44e6-86ec-e5dbcc7a6414 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:23.412132 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b863-8889-44e6-86ec-e5dbcc7a6414 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:23.412781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28b863-8889-44e6-86ec-e5dbcc7a6414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:23.413093 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28b863-8889-44e6-86ec-e5dbcc7a6414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:23.414478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28b863-8889-44e6-86ec-e5dbcc7a6414 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:23.427107 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 455/887] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:23.433574 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b043a9-9479-4e94-9e34-9bbf6f410c43 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:23.534507 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b043a9-9479-4e94-9e34-9bbf6f410c43 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:23.553916 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:23.568767 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732cbfc-0c1a-4009-ba36-84d8c4a99ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:23.569388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732cbfc-0c1a-4009-ba36-84d8c4a99ab1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:23.569666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732cbfc-0c1a-4009-ba36-84d8c4a99ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:23.569961 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732cbfc-0c1a-4009-ba36-84d8c4a99ab1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:23.577995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732cbfc-0c1a-4009-ba36-84d8c4a99ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:23.579437 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732cbfc-0c1a-4009-ba36-84d8c4a99ab1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-7732cbfc-0c1a-4009-ba36-84d8c4a99ab1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:18:23.591204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:23.598148 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:23.599424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 433/888] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:23.600133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28b863-8889-44e6-86ec-e5dbcc7a6414 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:23.700972 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28b863-8889-44e6-86ec-e5dbcc7a6414 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:23.736724 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c5177-6b75-4628-900f-170e0dd28eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:23.737945 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5177-6b75-4628-900f-170e0dd28eb1 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:23.738228 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5177-6b75-4628-900f-170e0dd28eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:23.738505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5177-6b75-4628-900f-170e0dd28eb1 None admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:23.739519 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c5177-6b75-4628-900f-170e0dd28eb1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:23.739823 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c5177-6b75-4628-900f-170e0dd28eb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:23.741261 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c5177-6b75-4628-900f-170e0dd28eb1 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:23.747404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:23.763133 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 456/889] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 11 18:18:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:23.768891 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732cbfc-0c1a-4009-ba36-84d8c4a99ab1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:23.870061 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732cbfc-0c1a-4009-ba36-84d8c4a99ab1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:23.904499 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324174c-e369-4cb2-b70b-440b9cbd8f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:23.905109 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324174c-e369-4cb2-b70b-440b9cbd8f85 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:23.905388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324174c-e369-4cb2-b70b-440b9cbd8f85 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:23.905658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324174c-e369-4cb2-b70b-440b9cbd8f85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:23.916412 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324174c-e369-4cb2-b70b-440b9cbd8f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:23.917844 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324174c-e369-4cb2-b70b-440b9cbd8f85 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-1324174c-e369-4cb2-b70b-440b9cbd8f85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:23.932619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:23.933794 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:23.935018 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:23.935018 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:23.935018 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:23.935018 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 434/890] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:23.939654 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c5177-6b75-4628-900f-170e0dd28eb1 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:24.047220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c5177-6b75-4628-900f-170e0dd28eb1 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:24.080557 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2e3a0-2b52-416f-9016-fd6da710103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:24.081349 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e3a0-2b52-416f-9016-fd6da710103d None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:24.081632 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e3a0-2b52-416f-9016-fd6da710103d None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:24.081904 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2e3a0-2b52-416f-9016-fd6da710103d None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:24.082530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2e3a0-2b52-416f-9016-fd6da710103d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:24.082859 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2e3a0-2b52-416f-9016-fd6da710103d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:24.084205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2e3a0-2b52-416f-9016-fd6da710103d None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:24.095294 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 457/891] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:24.101558 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324174c-e369-4cb2-b70b-440b9cbd8f85 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:24.133701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:24.200819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324174c-e369-4cb2-b70b-440b9cbd8f85 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:24.233866 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3bf6e-b013-483f-a5c1-e4278d36228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:24.237255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3bf6e-b013-483f-a5c1-e4278d36228d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:24.237255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3bf6e-b013-483f-a5c1-e4278d36228d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:24.237255 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3bf6e-b013-483f-a5c1-e4278d36228d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:24.241673 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3bf6e-b013-483f-a5c1-e4278d36228d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:24.243143 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3bf6e-b013-483f-a5c1-e4278d36228d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-97a3bf6e-b013-483f-a5c1-e4278d36228d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:18:24.254345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:24.255435 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:24.256727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:18:24.256727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:18:24.256727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:18:24.256727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:18:24.256727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:18:24.256727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:18:24.256727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:24.256727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:24.256727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 435/892] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:24.261280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2e3a0-2b52-416f-9016-fd6da710103d None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:24.317939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:24.363466 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2e3a0-2b52-416f-9016-fd6da710103d None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:24.397839 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12f5d7-46b2-4216-8ccb-0891f5cb694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:24.398459 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12f5d7-46b2-4216-8ccb-0891f5cb694c None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:24.398765 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12f5d7-46b2-4216-8ccb-0891f5cb694c None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:24.399038 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12f5d7-46b2-4216-8ccb-0891f5cb694c None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:24.399712 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12f5d7-46b2-4216-8ccb-0891f5cb694c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:24.400015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12f5d7-46b2-4216-8ccb-0891f5cb694c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:24.401425 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12f5d7-46b2-4216-8ccb-0891f5cb694c None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:24.413330 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 458/893] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:24.419411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3bf6e-b013-483f-a5c1-e4278d36228d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:24.511878 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:24.520676 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3bf6e-b013-483f-a5c1-e4278d36228d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:24.553598 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc85316-3641-4b13-9363-5b326b9b4c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:24.554240 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc85316-3641-4b13-9363-5b326b9b4c74 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:24.554517 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc85316-3641-4b13-9363-5b326b9b4c74 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:24.554819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc85316-3641-4b13-9363-5b326b9b4c74 None admin] PATH_INFO: `/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/3b58fad7b1e14a5f8c492a76a8840d44/roles/f89efd1f713043d8835c127de30f53ca` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:24.556708 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc85316-3641-4b13-9363-5b326b9b4c74 None admin] RBAC: Authorizing `identity:create_grant(project_id=a930d08c2f31471bbe6a66f5c626d22f, user_id=3b58fad7b1e14a5f8c492a76a8840d44, role_id=f89efd1f713043d8835c127de30f53ca)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:24.558115 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc85316-3641-4b13-9363-5b326b9b4c74 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:24.656851 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 436/894] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Aug 11 18:18:24 2022] PUT /identity/v3/projects/a930d08c2f31471bbe6a66f5c626d22f/users/3b58fad7b1e14a5f8c492a76a8840d44/roles/f89efd1f713043d8835c127de30f53ca => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:18:26.848765 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f102f-26ab-4c8e-835a-9fa3af0bce2f None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:26.849347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f102f-26ab-4c8e-835a-9fa3af0bce2f None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:26.849347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f102f-26ab-4c8e-835a-9fa3af0bce2f None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:26.850761 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 459/895] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:26.856089 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fca3b-be2f-48b2-a489-8efc47aee2c8 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:26.856532 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fca3b-be2f-48b2-a489-8efc47aee2c8 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:26.856632 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fca3b-be2f-48b2-a489-8efc47aee2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:26.875406 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ba1fca3b-be2f-48b2-a489-8efc47aee2c8 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:26.876573 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ba1fca3b-be2f-48b2-a489-8efc47aee2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:26.943074 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 437/896] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:26 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:18:27.282079 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f102f-26ab-4c8e-835a-9fa3af0bce2f None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:27.383306 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f102f-26ab-4c8e-835a-9fa3af0bce2f None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:27.397301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:27.416977 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfcf1c-8ca3-4ce7-a862-6dd97e9dba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:27.417580 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfcf1c-8ca3-4ce7-a862-6dd97e9dba66 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:27.417857 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfcf1c-8ca3-4ce7-a862-6dd97e9dba66 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:27.418124 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfcf1c-8ca3-4ce7-a862-6dd97e9dba66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:27.428541 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfcf1c-8ca3-4ce7-a862-6dd97e9dba66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-6bdfcf1c-8ca3-4ce7-a862-6dd97e9dba66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 18:18:27.433252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:27.434435 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:27.435561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 460/897] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Aug 11 18:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:27.440471 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fca3b-be2f-48b2-a489-8efc47aee2c8 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:27.521691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:27.542534 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fca3b-be2f-48b2-a489-8efc47aee2c8 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:27.575156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8d57b-5030-45f0-a011-f7d32433de07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:27.576058 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d57b-5030-45f0-a011-f7d32433de07 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:27.576340 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d57b-5030-45f0-a011-f7d32433de07 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:27.576847 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d57b-5030-45f0-a011-f7d32433de07 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:27.577563 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8d57b-5030-45f0-a011-f7d32433de07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:27.578231 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8d57b-5030-45f0-a011-f7d32433de07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:27.579736 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8d57b-5030-45f0-a011-f7d32433de07 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:27.588178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 438/898] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Aug 11 18:18:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:27.594237 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfcf1c-8ca3-4ce7-a862-6dd97e9dba66 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:27.695153 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfcf1c-8ca3-4ce7-a862-6dd97e9dba66 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:27.728908 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7669153-c835-40d5-b13d-423dcbfd8bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:27.730177 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669153-c835-40d5-b13d-423dcbfd8bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:27.730177 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669153-c835-40d5-b13d-423dcbfd8bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:27.730177 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669153-c835-40d5-b13d-423dcbfd8bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:27.743149 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7669153-c835-40d5-b13d-423dcbfd8bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:27.744605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7669153-c835-40d5-b13d-423dcbfd8bf0 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-d7669153-c835-40d5-b13d-423dcbfd8bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:27.760218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:27.761410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:27.762556 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:27.762556 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:27.762556 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:27.762556 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 461/899] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:18:27.767191 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8d57b-5030-45f0-a011-f7d32433de07 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:27.866627 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8d57b-5030-45f0-a011-f7d32433de07 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:27.904867 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc3ce8-4f2d-472a-a5a1-172f12ba6965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:27.905461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc3ce8-4f2d-472a-a5a1-172f12ba6965 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:27.905741 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc3ce8-4f2d-472a-a5a1-172f12ba6965 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:27.906015 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc3ce8-4f2d-472a-a5a1-172f12ba6965 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:27.906686 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc3ce8-4f2d-472a-a5a1-172f12ba6965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:27.906979 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc3ce8-4f2d-472a-a5a1-172f12ba6965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:27.908338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc3ce8-4f2d-472a-a5a1-172f12ba6965 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:27.919853 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 439/900] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:27.925724 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7669153-c835-40d5-b13d-423dcbfd8bf0 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:27.954728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:28.026081 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7669153-c835-40d5-b13d-423dcbfd8bf0 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:28.058395 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97072b6-bf27-46f2-8ba1-f329dd38e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:28.059042 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97072b6-bf27-46f2-8ba1-f329dd38e7cb None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:28.059326 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97072b6-bf27-46f2-8ba1-f329dd38e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:28.059599 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97072b6-bf27-46f2-8ba1-f329dd38e7cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:28.067761 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97072b6-bf27-46f2-8ba1-f329dd38e7cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:28.069252 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97072b6-bf27-46f2-8ba1-f329dd38e7cb None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-b97072b6-bf27-46f2-8ba1-f329dd38e7cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 18:18:28.080115 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:28.081899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:28.083134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:28.083134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:28.083134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 18:18:28.083134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 18:18:28.083134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 18:18:28.083134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 18:18:28.083134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 18:18:28.083134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 18:18:28.083134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 18:18:28.083134 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:28.088079 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 462/901] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:28.089870 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc3ce8-4f2d-472a-a5a1-172f12ba6965 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:28.091712 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:28.186550 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc3ce8-4f2d-472a-a5a1-172f12ba6965 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:28.220385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201c465-6df2-47a6-8537-4bbae9da69e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:28.220972 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c465-6df2-47a6-8537-4bbae9da69e1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:28.221251 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c465-6df2-47a6-8537-4bbae9da69e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:28.221625 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c465-6df2-47a6-8537-4bbae9da69e1 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:28.222345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201c465-6df2-47a6-8537-4bbae9da69e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:28.222650 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201c465-6df2-47a6-8537-4bbae9da69e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:28.224097 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201c465-6df2-47a6-8537-4bbae9da69e1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:28.241880 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 440/902] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Aug 11 18:18:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:18:28.247629 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97072b6-bf27-46f2-8ba1-f329dd38e7cb None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:28.331181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:28.345260 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97072b6-bf27-46f2-8ba1-f329dd38e7cb None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:28.380419 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b3f39-84a4-4527-9575-4f50b0edad33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:28.381012 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b3f39-84a4-4527-9575-4f50b0edad33 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:28.381294 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b3f39-84a4-4527-9575-4f50b0edad33 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:28.381566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b3f39-84a4-4527-9575-4f50b0edad33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:28.447094 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b3f39-84a4-4527-9575-4f50b0edad33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:28.448468 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b3f39-84a4-4527-9575-4f50b0edad33 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:28.529765 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:28.545020 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 463/903] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Aug 11 18:18:28 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 18:18:28.551493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201c465-6df2-47a6-8537-4bbae9da69e1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:28.610759 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:28.649223 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201c465-6df2-47a6-8537-4bbae9da69e1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:28.682573 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff631b-43e0-4b12-8686-35443df2b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:28.683226 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff631b-43e0-4b12-8686-35443df2b382 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:28.683506 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff631b-43e0-4b12-8686-35443df2b382 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:28.683779 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff631b-43e0-4b12-8686-35443df2b382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:28.693700 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff631b-43e0-4b12-8686-35443df2b382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:28.695178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff631b-43e0-4b12-8686-35443df2b382 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-3fff631b-43e0-4b12-8686-35443df2b382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 18:18:28.710371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:28.711560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 18:18:28.712898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 18:18:28.712898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 18:18:28.712898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:28.712898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 441/904] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:28.717208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b3f39-84a4-4527-9575-4f50b0edad33 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:28.816984 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b3f39-84a4-4527-9575-4f50b0edad33 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:28.850407 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512aa7f-3f9b-42c5-843e-f23c8053a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:28.851020 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512aa7f-3f9b-42c5-843e-f23c8053a549 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:28.851297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512aa7f-3f9b-42c5-843e-f23c8053a549 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:28.851566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512aa7f-3f9b-42c5-843e-f23c8053a549 None admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:28.852187 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512aa7f-3f9b-42c5-843e-f23c8053a549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:28.852736 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512aa7f-3f9b-42c5-843e-f23c8053a549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:28.854083 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512aa7f-3f9b-42c5-843e-f23c8053a549 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:28.868656 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 464/905] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Aug 11 18:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:28.874335 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff631b-43e0-4b12-8686-35443df2b382 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:28.975108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff631b-43e0-4b12-8686-35443df2b382 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:28.988438 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:29.008094 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2b496-60cf-4967-812b-23c1c695e9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:29.008716 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2b496-60cf-4967-812b-23c1c695e9f0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:29.008996 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2b496-60cf-4967-812b-23c1c695e9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:29.009265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2b496-60cf-4967-812b-23c1c695e9f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:29.015760 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2b496-60cf-4967-812b-23c1c695e9f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:29.017192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2b496-60cf-4967-812b-23c1c695e9f0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-5da2b496-60cf-4967-812b-23c1c695e9f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 18:18:29.028692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:29.029819 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:29.031056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 18:18:29.031056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 18:18:29.031056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 18:18:29.031056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 18:18:29.031056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 18:18:29.031056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 18:18:29.031056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 18:18:29.031056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Aug 11 18:18:29.031056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 442/906] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Aug 11 18:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:29.036390 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512aa7f-3f9b-42c5-843e-f23c8053a549 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:29.083324 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:29.138028 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512aa7f-3f9b-42c5-843e-f23c8053a549 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:29.172549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a504f-eafc-4310-8feb-c68b4e73f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:29.173142 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a504f-eafc-4310-8feb-c68b4e73f5cd None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:29.173420 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a504f-eafc-4310-8feb-c68b4e73f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:29.173690 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a504f-eafc-4310-8feb-c68b4e73f5cd None admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:29.174405 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a504f-eafc-4310-8feb-c68b4e73f5cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:29.174898 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a504f-eafc-4310-8feb-c68b4e73f5cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:29.176433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a504f-eafc-4310-8feb-c68b4e73f5cd None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:29.191731 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 465/907] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Aug 11 18:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:29.197830 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2b496-60cf-4967-812b-23c1c695e9f0 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:29.301950 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2b496-60cf-4967-812b-23c1c695e9f0 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:29.335131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde3ac5-99b1-498e-9a39-52e0d0c0f148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:29.335717 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde3ac5-99b1-498e-9a39-52e0d0c0f148 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:29.335995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde3ac5-99b1-498e-9a39-52e0d0c0f148 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:29.336264 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde3ac5-99b1-498e-9a39-52e0d0c0f148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:29.336970 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde3ac5-99b1-498e-9a39-52e0d0c0f148 None admin] RBAC: Adding query filter params (role.id=f89efd1f713043d8835c127de30f53ca, scope.project.id=a930d08c2f31471bbe6a66f5c626d22f, user.id=3b58fad7b1e14a5f8c492a76a8840d44) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:29.337275 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde3ac5-99b1-498e-9a39-52e0d0c0f148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:29.338773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde3ac5-99b1-498e-9a39-52e0d0c0f148 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:29.344356 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 443/908] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Aug 11 18:18:29 2022] GET /identity/v3/role_assignments?user.id=3b58fad7b1e14a5f8c492a76a8840d44&scope.project.id=a930d08c2f31471bbe6a66f5c626d22f&role.id=f89efd1f713043d8835c127de30f53ca => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:31.543213 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7da36d-7c8d-4062-8d49-7392260fcf31 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:31.543781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7da36d-7c8d-4062-8d49-7392260fcf31 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:31.543781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7da36d-7c8d-4062-8d49-7392260fcf31 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:31.545066 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 466/909] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:31.550232 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5df95-56cd-4720-8bf8-dcee30c1ef24 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:31.552337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5df95-56cd-4720-8bf8-dcee30c1ef24 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:31.552337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5df95-56cd-4720-8bf8-dcee30c1ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:31.569699 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-9cb5df95-56cd-4720-8bf8-dcee30c1ef24 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:31.570944 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-9cb5df95-56cd-4720-8bf8-dcee30c1ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:31.600598 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:31.637754 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 444/910] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:31 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:18:31.966800 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7da36d-7c8d-4062-8d49-7392260fcf31 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:32.067433 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7da36d-7c8d-4062-8d49-7392260fcf31 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:32.074449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:32.101055 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dce572-69f6-4c6d-9a8b-678dfe7d3ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:32.101665 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce572-69f6-4c6d-9a8b-678dfe7d3ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:32.101942 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce572-69f6-4c6d-9a8b-678dfe7d3ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:32.102218 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce572-69f6-4c6d-9a8b-678dfe7d3ff6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:32.102816 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dce572-69f6-4c6d-9a8b-678dfe7d3ff6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:32.104182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dce572-69f6-4c6d-9a8b-678dfe7d3ff6 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-d3dce572-69f6-4c6d-9a8b-678dfe7d3ff6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:32.112835 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:32.114314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:32.115666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 467/911] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 11 18:18:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 18:18:32.120296 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5df95-56cd-4720-8bf8-dcee30c1ef24 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:32.217964 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5df95-56cd-4720-8bf8-dcee30c1ef24 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:32.251858 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828bd98-4f13-4898-b952-8ef3ff36370c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:32.252501 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828bd98-4f13-4898-b952-8ef3ff36370c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:32.253099 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828bd98-4f13-4898-b952-8ef3ff36370c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:32.253099 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828bd98-4f13-4898-b952-8ef3ff36370c None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:32.253642 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828bd98-4f13-4898-b952-8ef3ff36370c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:32.253947 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828bd98-4f13-4898-b952-8ef3ff36370c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:32.255352 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828bd98-4f13-4898-b952-8ef3ff36370c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:32.259944 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 445/912] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Aug 11 18:18:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:32.265846 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dce572-69f6-4c6d-9a8b-678dfe7d3ff6 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:32.365281 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dce572-69f6-4c6d-9a8b-678dfe7d3ff6 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:32.398545 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135921f-60da-4259-8a96-f7addbb501a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:32.399162 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135921f-60da-4259-8a96-f7addbb501a7 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:32.399445 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135921f-60da-4259-8a96-f7addbb501a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:32.399716 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135921f-60da-4259-8a96-f7addbb501a7 None admin] PATH_INFO: `/v3/services` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:32.400329 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135921f-60da-4259-8a96-f7addbb501a7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:32.400630 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135921f-60da-4259-8a96-f7addbb501a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:32.401980 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135921f-60da-4259-8a96-f7addbb501a7 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:32.406216 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 468/913] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Aug 11 18:18:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:34.559254 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96fbc0-74c6-43b0-a6dd-b24538723151 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:34.559781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96fbc0-74c6-43b0-a6dd-b24538723151 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:34.559781 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96fbc0-74c6-43b0-a6dd-b24538723151 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:34.561170 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 446/914] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:34.566879 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab95635-3a7b-44d3-a75c-dc15cce4d8f0 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:34.568582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab95635-3a7b-44d3-a75c-dc15cce4d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:34.568582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab95635-3a7b-44d3-a75c-dc15cce4d8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:34.585834 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-dab95635-3a7b-44d3-a75c-dc15cce4d8f0 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:34.587057 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-dab95635-3a7b-44d3-a75c-dc15cce4d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:34.612858 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:34.653198 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 469/915] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:34 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 18:18:34.981813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96fbc0-74c6-43b0-a6dd-b24538723151 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:35.014183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:35.084976 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96fbc0-74c6-43b0-a6dd-b24538723151 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:35.118557 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5d335-b0eb-4012-83e8-6e2503b3f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:35.119182 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5d335-b0eb-4012-83e8-6e2503b3f3d3 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:35.119463 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5d335-b0eb-4012-83e8-6e2503b3f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:35.119738 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5d335-b0eb-4012-83e8-6e2503b3f3d3 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:35.120376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5d335-b0eb-4012-83e8-6e2503b3f3d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:35.121771 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5d335-b0eb-4012-83e8-6e2503b3f3d3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:35.207857 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 447/916] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Aug 11 18:18:34 2022] POST /identity/v3/services => generated 246 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:18:37.410259 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd32b-7957-43fc-8e23-f5969cc7c67a None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:37.410810 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd32b-7957-43fc-8e23-f5969cc7c67a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:37.410925 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd32b-7957-43fc-8e23-f5969cc7c67a None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:37.412255 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 470/917] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:37.417321 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd30ad3-ee4a-45b9-ba8b-24339dfb3313 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:37.417696 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd30ad3-ee4a-45b9-ba8b-24339dfb3313 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:37.417875 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd30ad3-ee4a-45b9-ba8b-24339dfb3313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:37.435657 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-3fd30ad3-ee4a-45b9-ba8b-24339dfb3313 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:37.436833 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-3fd30ad3-ee4a-45b9-ba8b-24339dfb3313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:37.509588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 448/918] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:37 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:18:37.833372 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dd32b-7957-43fc-8e23-f5969cc7c67a None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:37.933894 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dd32b-7957-43fc-8e23-f5969cc7c67a None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:37.967537 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84882804-2254-4112-9251-308c1172c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:37.968147 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84882804-2254-4112-9251-308c1172c56a None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:37.968425 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84882804-2254-4112-9251-308c1172c56a None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:37.968693 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84882804-2254-4112-9251-308c1172c56a None admin] PATH_INFO: `/v3/services/placement` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:37.969261 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84882804-2254-4112-9251-308c1172c56a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:37.970614 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84882804-2254-4112-9251-308c1172c56a None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-84882804-2254-4112-9251-308c1172c56a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:37.979160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:37.989121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:37.990052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 471/919] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 11 18:18:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:37.990935 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd30ad3-ee4a-45b9-ba8b-24339dfb3313 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:38.007398 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:38.087615 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd30ad3-ee4a-45b9-ba8b-24339dfb3313 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:38.121101 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889f64b-f654-4d8e-b0be-1587c9433235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:38.121687 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f64b-f654-4d8e-b0be-1587c9433235 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:38.121962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f64b-f654-4d8e-b0be-1587c9433235 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:38.122230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f64b-f654-4d8e-b0be-1587c9433235 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:38.122909 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889f64b-f654-4d8e-b0be-1587c9433235 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:38.123207 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889f64b-f654-4d8e-b0be-1587c9433235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:38.124613 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889f64b-f654-4d8e-b0be-1587c9433235 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:38.130264 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 449/920] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Aug 11 18:18:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:38.136383 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84882804-2254-4112-9251-308c1172c56a None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:38.165167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:38.235297 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84882804-2254-4112-9251-308c1172c56a None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:38.269283 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f84c1-7bfc-47ac-9a2a-39ad242ce012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:38.269815 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f84c1-7bfc-47ac-9a2a-39ad242ce012 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:38.270099 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f84c1-7bfc-47ac-9a2a-39ad242ce012 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:38.270378 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f84c1-7bfc-47ac-9a2a-39ad242ce012 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:38.271106 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f84c1-7bfc-47ac-9a2a-39ad242ce012 None admin] RBAC: Adding query filter params (interface=public, service_id=ac60447124c741f2857fdacf99b09202, region_id=RegionOne) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:38.271415 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f84c1-7bfc-47ac-9a2a-39ad242ce012 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:38.272782 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f84c1-7bfc-47ac-9a2a-39ad242ce012 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:38.277990 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 472/921] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Aug 11 18:18:38 2022] GET /identity/v3/endpoints?service_id=ac60447124c741f2857fdacf99b09202&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:38.284320 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889f64b-f654-4d8e-b0be-1587c9433235 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:38.365740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:38.383548 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889f64b-f654-4d8e-b0be-1587c9433235 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:38.416961 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47489fd-be11-46b6-95c9-f973451b57d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:38.417553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47489fd-be11-46b6-95c9-f973451b57d4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:38.418085 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47489fd-be11-46b6-95c9-f973451b57d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:38.418085 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47489fd-be11-46b6-95c9-f973451b57d4 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:38.418698 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47489fd-be11-46b6-95c9-f973451b57d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:38.420112 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47489fd-be11-46b6-95c9-f973451b57d4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:38.428046 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 450/922] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Aug 11 18:18:38 2022] GET /identity/v3/services => generated 1962 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:18:40.606344 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727090-7529-4b10-bc8d-71186e854518 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:40.606902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727090-7529-4b10-bc8d-71186e854518 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:40.606902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727090-7529-4b10-bc8d-71186e854518 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:40.608251 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 473/923] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:18:40.613985 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb416c-32f1-480e-ba05-31e50621ab6c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:40.614405 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb416c-32f1-480e-ba05-31e50621ab6c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:40.614540 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb416c-32f1-480e-ba05-31e50621ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:40.632990 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c9cb416c-32f1-480e-ba05-31e50621ab6c None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:18:40.634173 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c9cb416c-32f1-480e-ba05-31e50621ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:18:40.699278 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 451/924] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:18:40 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 18:18:41.025138 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727090-7529-4b10-bc8d-71186e854518 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:41.116741 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:41.126024 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727090-7529-4b10-bc8d-71186e854518 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:41.159074 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33e16-56ee-4aca-a81b-9a3fd5256620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:41.159690 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33e16-56ee-4aca-a81b-9a3fd5256620 None admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:41.159974 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33e16-56ee-4aca-a81b-9a3fd5256620 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:41.160245 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33e16-56ee-4aca-a81b-9a3fd5256620 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:41.160812 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe33e16-56ee-4aca-a81b-9a3fd5256620 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:41.162172 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe33e16-56ee-4aca-a81b-9a3fd5256620 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application [None req-5fe33e16-56ee-4aca-a81b-9a3fd5256620 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 18:18:41.170600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 18:18:41.171772 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application with Lock( Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self._enter() Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application return self.creator() Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application created_value = creator( Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: ERROR keystone.server.flask.application Aug 11 18:18:41.172814 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 474/925] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Aug 11 18:18:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 18:18:41.178136 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb416c-32f1-480e-ba05-31e50621ab6c None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:41.255027 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:41.277472 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb416c-32f1-480e-ba05-31e50621ab6c None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:41.310416 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d63a55-e2f9-4cc2-a3d8-e23fbc67bd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:41.311157 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63a55-e2f9-4cc2-a3d8-e23fbc67bd30 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:41.311433 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63a55-e2f9-4cc2-a3d8-e23fbc67bd30 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:41.311706 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63a55-e2f9-4cc2-a3d8-e23fbc67bd30 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:41.312323 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d63a55-e2f9-4cc2-a3d8-e23fbc67bd30 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:18:41.312622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d63a55-e2f9-4cc2-a3d8-e23fbc67bd30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:41.313986 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d63a55-e2f9-4cc2-a3d8-e23fbc67bd30 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:41.319858 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 452/926] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Aug 11 18:18:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:18:41.325648 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33e16-56ee-4aca-a81b-9a3fd5256620 None admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:18:41.425800 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33e16-56ee-4aca-a81b-9a3fd5256620 None admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:18:41.459467 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec72b4f-4335-4aba-8026-1d3d95660619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:18:41.460062 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec72b4f-4335-4aba-8026-1d3d95660619 None admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:18:41.460343 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec72b4f-4335-4aba-8026-1d3d95660619 None admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:18:41.460617 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec72b4f-4335-4aba-8026-1d3d95660619 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:18:41.461315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec72b4f-4335-4aba-8026-1d3d95660619 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:18:41.462680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec72b4f-4335-4aba-8026-1d3d95660619 None admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:18:41.542878 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 475/927] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:18:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:18:51.333544 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=30 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:18:51.538349 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:24:49.515381 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8c732-4bcf-44d1-9e76-db2e45243478 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:49.516267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8c732-4bcf-44d1-9e76-db2e45243478 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:49.516708 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8c732-4bcf-44d1-9e76-db2e45243478 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:49.518808 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 453/928] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:24:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:24:49.523567 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ace0-61e6-4c2a-b682-d16cc5c20a47 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:49.524008 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ace0-61e6-4c2a-b682-d16cc5c20a47 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:49.524161 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ace0-61e6-4c2a-b682-d16cc5c20a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:49.653131 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-30a2ace0-61e6-4c2a-b682-d16cc5c20a47 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:24:49.654471 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-30a2ace0-61e6-4c2a-b682-d16cc5c20a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:24:49.810704 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 476/929] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:24:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:24:50.174600 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed28bb-1f90-4f50-9238-c663f9cce46f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:50.174927 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed28bb-1f90-4f50-9238-c663f9cce46f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:50.175206 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed28bb-1f90-4f50-9238-c663f9cce46f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:50.176549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 454/930] 10.222.0.15 () {54 vars in 965 bytes} [Thu Aug 11 18:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:24:50.182348 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3a67c-7c53-4205-aa21-7ad554b66e73 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:50.182633 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3a67c-7c53-4205-aa21-7ad554b66e73 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:50.182928 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3a67c-7c53-4205-aa21-7ad554b66e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:50.241707 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-91f3a67c-7c53-4205-aa21-7ad554b66e73 None None] MFA Rules not processed for user `55256cb1c7f743ffa544dbd388103ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:24:50.242931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-91f3a67c-7c53-4205-aa21-7ad554b66e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:24:50.284385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:24:50.319144 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 477/931] 10.222.0.15 () {58 vars in 1062 bytes} [Thu Aug 11 18:24:50 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:24:50.329703 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed28bb-1f90-4f50-9238-c663f9cce46f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:24:50.341579 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed28bb-1f90-4f50-9238-c663f9cce46f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:24:50.345256 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bd44f-34ca-4c64-875d-452d2bb7f4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:24:50.345875 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bd44f-34ca-4c64-875d-452d2bb7f4bf service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:50.346154 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bd44f-34ca-4c64-875d-452d2bb7f4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:50.346424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bd44f-34ca-4c64-875d-452d2bb7f4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:50.356438 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bd44f-34ca-4c64-875d-452d2bb7f4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:24:50.358117 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bd44f-34ca-4c64-875d-452d2bb7f4bf service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:24:50.369009 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 455/932] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:24:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:24:52.834354 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe654d-fa93-4151-8a53-ce84b8c668fd None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:52.834936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe654d-fa93-4151-8a53-ce84b8c668fd None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:52.834936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe654d-fa93-4151-8a53-ce84b8c668fd None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:52.836314 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 478/933] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:24:52.842898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6a01a-a61d-40b6-a9db-a6d280db1f18 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:52.843412 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6a01a-a61d-40b6-a9db-a6d280db1f18 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:52.843488 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6a01a-a61d-40b6-a9db-a6d280db1f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:52.863733 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-0ec6a01a-a61d-40b6-a9db-a6d280db1f18 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:24:52.864953 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-0ec6a01a-a61d-40b6-a9db-a6d280db1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:24:52.873630 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 456/934] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:24:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:24:53.221745 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe654d-fa93-4151-8a53-ce84b8c668fd None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:24:53.233389 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe654d-fa93-4151-8a53-ce84b8c668fd None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:24:53.242081 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b246e66-b1bb-485d-9758-1e3c7f86aa61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:24:53.242723 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b246e66-b1bb-485d-9758-1e3c7f86aa61 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:53.243013 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b246e66-b1bb-485d-9758-1e3c7f86aa61 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:53.243379 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b246e66-b1bb-485d-9758-1e3c7f86aa61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:53.253125 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b246e66-b1bb-485d-9758-1e3c7f86aa61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:24:53.254561 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b246e66-b1bb-485d-9758-1e3c7f86aa61 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:24:53.275704 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 479/935] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:24:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:24:56.049605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817aad2-39ae-40db-bf2d-bd10d2f4b843 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:56.050145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817aad2-39ae-40db-bf2d-bd10d2f4b843 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:56.050254 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817aad2-39ae-40db-bf2d-bd10d2f4b843 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:56.051658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 457/936] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:24:56.057598 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35c2d-91db-41dc-b0ea-216933cdec5d None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:56.058120 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35c2d-91db-41dc-b0ea-216933cdec5d None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:56.058208 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35c2d-91db-41dc-b0ea-216933cdec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:56.116697 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-c7b35c2d-91db-41dc-b0ea-216933cdec5d None None] MFA Rules not processed for user `c790b85dd5ed4c03b864ddd177ed5e03`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:24:56.117890 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-c7b35c2d-91db-41dc-b0ea-216933cdec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:24:56.200000 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 480/937] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:24:56 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:24:56.561242 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99c75-c2e8-4834-8614-05c9b8d6ab95 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:56.561520 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99c75-c2e8-4834-8614-05c9b8d6ab95 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:56.561792 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be99c75-c2e8-4834-8614-05c9b8d6ab95 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:56.563168 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 458/938] 10.222.0.15 () {54 vars in 965 bytes} [Thu Aug 11 18:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:24:56.569620 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb5ea8-e0c0-40d1-bfac-b23d39a63971 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:56.569995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb5ea8-e0c0-40d1-bfac-b23d39a63971 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:56.570270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb5ea8-e0c0-40d1-bfac-b23d39a63971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:56.592022 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-45bb5ea8-e0c0-40d1-bfac-b23d39a63971 None None] MFA Rules not processed for user `55256cb1c7f743ffa544dbd388103ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:24:56.593244 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-45bb5ea8-e0c0-40d1-bfac-b23d39a63971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:24:56.599808 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 481/939] 10.222.0.15 () {58 vars in 1062 bytes} [Thu Aug 11 18:24:56 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:24:56.609671 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be99c75-c2e8-4834-8614-05c9b8d6ab95 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:24:56.620695 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be99c75-c2e8-4834-8614-05c9b8d6ab95 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:24:56.624617 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dc86d-be7b-44c7-b686-890cb42abd2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:24:56.625215 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc86d-be7b-44c7-b686-890cb42abd2d service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:24:56.625492 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc86d-be7b-44c7-b686-890cb42abd2d service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:24:56.625762 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dc86d-be7b-44c7-b686-890cb42abd2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:24:56.635304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dc86d-be7b-44c7-b686-890cb42abd2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:24:56.636754 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dc86d-be7b-44c7-b686-890cb42abd2d service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:24:56.648620 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 459/940] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:24:56 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:00.025538 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4a3af-921f-4ae0-ad2f-06a521c1d706 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:00.026067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4a3af-921f-4ae0-ad2f-06a521c1d706 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:00.026067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4a3af-921f-4ae0-ad2f-06a521c1d706 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:00.027471 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 482/941] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:00.033501 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07efd5d-5702-4d4b-94a6-2db15a539d43 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:00.033952 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07efd5d-5702-4d4b-94a6-2db15a539d43 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:00.034063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07efd5d-5702-4d4b-94a6-2db15a539d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:00.053262 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f07efd5d-5702-4d4b-94a6-2db15a539d43 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:00.054493 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f07efd5d-5702-4d4b-94a6-2db15a539d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:00.120857 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 460/942] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:00 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:00.463895 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4a3af-921f-4ae0-ad2f-06a521c1d706 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:00.475095 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4a3af-921f-4ae0-ad2f-06a521c1d706 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:00.478457 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb24ce-af6a-4af5-bc98-8e438622162e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:00.479075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb24ce-af6a-4af5-bc98-8e438622162e service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:00.479353 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb24ce-af6a-4af5-bc98-8e438622162e service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:00.479620 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb24ce-af6a-4af5-bc98-8e438622162e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:00.488196 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb24ce-af6a-4af5-bc98-8e438622162e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:00.489860 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb24ce-af6a-4af5-bc98-8e438622162e service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:00.499061 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 483/943] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:00 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:03.767912 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3eeb4-8497-46cc-a4e9-adda5f5c5c3a None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:03.768423 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3eeb4-8497-46cc-a4e9-adda5f5c5c3a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:03.768515 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3eeb4-8497-46cc-a4e9-adda5f5c5c3a None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:03.769806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 461/944] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:03.774937 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d8e9e-6462-43bd-951e-7051c3a3e7c1 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:03.775367 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d8e9e-6462-43bd-951e-7051c3a3e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:03.775485 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d8e9e-6462-43bd-951e-7051c3a3e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:03.796492 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-0e4d8e9e-6462-43bd-951e-7051c3a3e7c1 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:03.797682 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-0e4d8e9e-6462-43bd-951e-7051c3a3e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:03.805990 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 484/945] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:04.170040 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3eeb4-8497-46cc-a4e9-adda5f5c5c3a None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:04.180883 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3eeb4-8497-46cc-a4e9-adda5f5c5c3a None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:04.185554 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494f799-4515-4317-bce4-b41957eb32db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:04.186145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f799-4515-4317-bce4-b41957eb32db service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:04.186424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f799-4515-4317-bce4-b41957eb32db service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:04.187274 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f799-4515-4317-bce4-b41957eb32db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:04.196289 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494f799-4515-4317-bce4-b41957eb32db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:04.197709 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494f799-4515-4317-bce4-b41957eb32db service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:04.208517 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 462/946] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:06.472113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7dce8-13e5-4db7-a619-46de3b7d6b9d None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:06.472670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7dce8-13e5-4db7-a619-46de3b7d6b9d None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:06.472670 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7dce8-13e5-4db7-a619-46de3b7d6b9d None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:06.473863 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 485/947] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:06.479060 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ac77-d525-454d-adf7-88c6a65d1350 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:06.479483 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ac77-d525-454d-adf7-88c6a65d1350 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:06.479620 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ac77-d525-454d-adf7-88c6a65d1350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:06.500056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b5d3ac77-d525-454d-adf7-88c6a65d1350 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:06.501304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b5d3ac77-d525-454d-adf7-88c6a65d1350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:06.509156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 463/948] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:06.844601 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7dce8-13e5-4db7-a619-46de3b7d6b9d None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:06.855273 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7dce8-13e5-4db7-a619-46de3b7d6b9d None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:06.858921 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba72e6c-4f17-44b3-b0d5-a596e43e67b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:06.859504 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba72e6c-4f17-44b3-b0d5-a596e43e67b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:06.859781 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba72e6c-4f17-44b3-b0d5-a596e43e67b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:06.860052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba72e6c-4f17-44b3-b0d5-a596e43e67b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:06.869259 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba72e6c-4f17-44b3-b0d5-a596e43e67b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:06.870734 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba72e6c-4f17-44b3-b0d5-a596e43e67b5 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:06.880847 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 486/949] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:09.116608 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec3ad-fc05-4249-bd33-7634f2f1642d None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:09.117077 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec3ad-fc05-4249-bd33-7634f2f1642d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:09.117176 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec3ad-fc05-4249-bd33-7634f2f1642d None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:09.118495 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 464/950] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:09.123770 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29bcd2-be65-4b63-9083-f86fb445f4cd None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:09.124162 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29bcd2-be65-4b63-9083-f86fb445f4cd None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:09.124318 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29bcd2-be65-4b63-9083-f86fb445f4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:09.142793 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-fe29bcd2-be65-4b63-9083-f86fb445f4cd None None] MFA Rules not processed for user `c790b85dd5ed4c03b864ddd177ed5e03`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:09.143978 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-fe29bcd2-be65-4b63-9083-f86fb445f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:09.151594 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 487/951] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:09 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:09.493320 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cec3ad-fc05-4249-bd33-7634f2f1642d None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:09.504553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cec3ad-fc05-4249-bd33-7634f2f1642d None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:09.508019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605844ab-d567-4b07-acbc-d4151aed9d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:09.508605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605844ab-d567-4b07-acbc-d4151aed9d67 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:09.508885 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605844ab-d567-4b07-acbc-d4151aed9d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:09.509162 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605844ab-d567-4b07-acbc-d4151aed9d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:09.517831 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605844ab-d567-4b07-acbc-d4151aed9d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:09.519314 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605844ab-d567-4b07-acbc-d4151aed9d67 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:09.528664 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 465/952] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:09 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:12.202893 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e4d79-abd2-4a5c-ab88-5f906df9c023 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:12.203413 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e4d79-abd2-4a5c-ab88-5f906df9c023 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:12.203413 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e4d79-abd2-4a5c-ab88-5f906df9c023 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:12.204661 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 488/953] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:12.209935 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a14c2c-654b-4bba-8a77-dc7196e68636 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:12.210361 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a14c2c-654b-4bba-8a77-dc7196e68636 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:12.210509 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a14c2c-654b-4bba-8a77-dc7196e68636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:12.218914 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=62 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:25:12.232501 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c9a14c2c-654b-4bba-8a77-dc7196e68636 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:12.233711 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c9a14c2c-654b-4bba-8a77-dc7196e68636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:12.241912 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 466/954] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:12.580520 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e4d79-abd2-4a5c-ab88-5f906df9c023 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:12.591989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e4d79-abd2-4a5c-ab88-5f906df9c023 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:12.595202 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172020bd-816b-436e-b05b-6551967e8e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:12.595812 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172020bd-816b-436e-b05b-6551967e8e9c service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:12.596089 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172020bd-816b-436e-b05b-6551967e8e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:12.596359 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172020bd-816b-436e-b05b-6551967e8e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:12.606658 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172020bd-816b-436e-b05b-6551967e8e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:12.608130 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172020bd-816b-436e-b05b-6551967e8e9c service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:12.618611 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 489/955] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:14.862145 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137ca15-3c8e-492c-9a3b-e82546b4fd5b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:14.862726 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137ca15-3c8e-492c-9a3b-e82546b4fd5b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:14.862726 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137ca15-3c8e-492c-9a3b-e82546b4fd5b None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:14.864478 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 467/956] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:14.869434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60010e1-c9b2-474a-a7c6-9f86f851de39 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:14.869834 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60010e1-c9b2-474a-a7c6-9f86f851de39 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:14.870090 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60010e1-c9b2-474a-a7c6-9f86f851de39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:14.877677 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:25:14.889266 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-b60010e1-c9b2-474a-a7c6-9f86f851de39 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:14.898991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-b60010e1-c9b2-474a-a7c6-9f86f851de39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:14.898991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 490/957] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:15.244019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137ca15-3c8e-492c-9a3b-e82546b4fd5b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:15.255678 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137ca15-3c8e-492c-9a3b-e82546b4fd5b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:15.259258 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a80c2-384d-4254-a682-b12a704c44eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:15.259853 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a80c2-384d-4254-a682-b12a704c44eb service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:15.260134 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a80c2-384d-4254-a682-b12a704c44eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:15.260407 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a80c2-384d-4254-a682-b12a704c44eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:15.270566 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a80c2-384d-4254-a682-b12a704c44eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:15.272032 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a80c2-384d-4254-a682-b12a704c44eb service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:15.282575 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 468/958] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:18.055612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26acb-be12-493c-99a4-05db344d27f7 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:18.056119 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26acb-be12-493c-99a4-05db344d27f7 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:18.056119 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26acb-be12-493c-99a4-05db344d27f7 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:18.057436 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 491/959] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:18.063186 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf130cd-27cc-4b43-b7ea-d8e40b642ae7 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:18.063600 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf130cd-27cc-4b43-b7ea-d8e40b642ae7 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:18.063762 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf130cd-27cc-4b43-b7ea-d8e40b642ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:18.088388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-aaf130cd-27cc-4b43-b7ea-d8e40b642ae7 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:18.088388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-aaf130cd-27cc-4b43-b7ea-d8e40b642ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:18.093926 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 469/960] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:18 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:18.434480 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26acb-be12-493c-99a4-05db344d27f7 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:18.444980 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26acb-be12-493c-99a4-05db344d27f7 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:18.448460 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc085800-5853-44de-9f88-56559123ef0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:18.449041 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc085800-5853-44de-9f88-56559123ef0f service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:18.449318 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc085800-5853-44de-9f88-56559123ef0f service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:18.450084 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc085800-5853-44de-9f88-56559123ef0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:18.458998 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc085800-5853-44de-9f88-56559123ef0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:18.460417 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc085800-5853-44de-9f88-56559123ef0f service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:18.470499 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 492/961] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:18 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:22.796293 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864b764-d517-464f-b67e-68e5857c8d22 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:22.796809 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864b764-d517-464f-b67e-68e5857c8d22 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:22.796940 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864b764-d517-464f-b67e-68e5857c8d22 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:22.798164 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 470/962] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:22.803510 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825be8b-a410-4671-b071-3c5b31c4f22c None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:22.803911 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825be8b-a410-4671-b071-3c5b31c4f22c None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:22.804066 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825be8b-a410-4671-b071-3c5b31c4f22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:22.824236 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-d825be8b-a410-4671-b071-3c5b31c4f22c None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:22.825860 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-d825be8b-a410-4671-b071-3c5b31c4f22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:22.833601 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 493/963] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:23.182364 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864b764-d517-464f-b67e-68e5857c8d22 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:23.194152 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864b764-d517-464f-b67e-68e5857c8d22 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:23.197555 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6327977-a512-4397-9c51-6564b2d38d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:23.198141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6327977-a512-4397-9c51-6564b2d38d90 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:23.198416 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6327977-a512-4397-9c51-6564b2d38d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:23.198703 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6327977-a512-4397-9c51-6564b2d38d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:23.208588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6327977-a512-4397-9c51-6564b2d38d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:23.210000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6327977-a512-4397-9c51-6564b2d38d90 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:23.219926 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 471/964] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:26.610162 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca79934-f85b-4ff6-b0c2-faf0fe2ffa60 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:26.610730 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca79934-f85b-4ff6-b0c2-faf0fe2ffa60 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:26.610730 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca79934-f85b-4ff6-b0c2-faf0fe2ffa60 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:26.612057 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 494/965] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:26.617369 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf51fc4-4756-46c9-b7ea-a2466e33ee68 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:26.617809 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf51fc4-4756-46c9-b7ea-a2466e33ee68 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:26.617955 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf51fc4-4756-46c9-b7ea-a2466e33ee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:26.638419 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-acf51fc4-4756-46c9-b7ea-a2466e33ee68 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:26.639666 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-acf51fc4-4756-46c9-b7ea-a2466e33ee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:26.647473 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 472/966] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:26 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:26.994128 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca79934-f85b-4ff6-b0c2-faf0fe2ffa60 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:27.005524 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca79934-f85b-4ff6-b0c2-faf0fe2ffa60 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:27.009034 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4aaa2-5c3f-414b-9bd0-cefd6d56239b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:27.009612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4aaa2-5c3f-414b-9bd0-cefd6d56239b service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:27.009896 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4aaa2-5c3f-414b-9bd0-cefd6d56239b service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:27.010172 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4aaa2-5c3f-414b-9bd0-cefd6d56239b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:27.020087 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4aaa2-5c3f-414b-9bd0-cefd6d56239b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:27.021519 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4aaa2-5c3f-414b-9bd0-cefd6d56239b service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:27.031890 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 495/967] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:26 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:31.590024 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06366a1f-5634-4d55-9038-0e3fa7e7a4a4 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:31.591161 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06366a1f-5634-4d55-9038-0e3fa7e7a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:31.591161 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06366a1f-5634-4d55-9038-0e3fa7e7a4a4 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:31.592534 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 473/968] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:31.598004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b72af-7658-4ef1-aeb9-bc9bd0597a3a None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:31.598403 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b72af-7658-4ef1-aeb9-bc9bd0597a3a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:31.598710 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b72af-7658-4ef1-aeb9-bc9bd0597a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:31.619590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-d34b72af-7658-4ef1-aeb9-bc9bd0597a3a None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:31.620793 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-d34b72af-7658-4ef1-aeb9-bc9bd0597a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:31.628816 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 496/969] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:25:31.974862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06366a1f-5634-4d55-9038-0e3fa7e7a4a4 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:31.985761 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06366a1f-5634-4d55-9038-0e3fa7e7a4a4 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:31.989455 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d19f4-3edd-4636-b7cf-548bc33d7a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:31.990054 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d19f4-3edd-4636-b7cf-548bc33d7a00 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:31.990326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d19f4-3edd-4636-b7cf-548bc33d7a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:31.990598 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d19f4-3edd-4636-b7cf-548bc33d7a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:32.000245 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d19f4-3edd-4636-b7cf-548bc33d7a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:32.001659 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d19f4-3edd-4636-b7cf-548bc33d7a00 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:32.011230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 474/970] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:37.463424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c2e14-c165-47e2-8390-25356388b4e8 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:37.463894 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c2e14-c165-47e2-8390-25356388b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:37.463994 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c2e14-c165-47e2-8390-25356388b4e8 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:37.465615 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 497/971] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 11 18:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:37.470740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d66b15-fed2-46bc-99bc-6ecc7fc28f5a None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:37.471572 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d66b15-fed2-46bc-99bc-6ecc7fc28f5a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:37.472056 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d66b15-fed2-46bc-99bc-6ecc7fc28f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:37.513235 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-29d66b15-fed2-46bc-99bc-6ecc7fc28f5a None None] MFA Rules not processed for user `3b58fad7b1e14a5f8c492a76a8840d44`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:37.514908 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-29d66b15-fed2-46bc-99bc-6ecc7fc28f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:37.631192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 475/972] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 11 18:25:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:41.614869 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=20 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:25:42.127531 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cef94-eb01-4833-915b-a75bb8e8d132 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:42.128022 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cef94-eb01-4833-915b-a75bb8e8d132 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:42.128299 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cef94-eb01-4833-915b-a75bb8e8d132 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:42.129789 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 498/973] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 11 18:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:42.134788 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec64e10-d005-4bc5-9b55-da7c53a146f9 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:42.135229 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec64e10-d005-4bc5-9b55-da7c53a146f9 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:42.135335 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec64e10-d005-4bc5-9b55-da7c53a146f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:42.157737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-2ec64e10-d005-4bc5-9b55-da7c53a146f9 None None] MFA Rules not processed for user `3b58fad7b1e14a5f8c492a76a8840d44`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:42.159136 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-2ec64e10-d005-4bc5-9b55-da7c53a146f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:42.169505 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 476/974] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 11 18:25:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:43.878076 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5197-62c0-4b54-9cb9-5ec5581cc136 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:43.878653 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5197-62c0-4b54-9cb9-5ec5581cc136 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:43.878653 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5197-62c0-4b54-9cb9-5ec5581cc136 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:43.879996 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 499/975] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 11 18:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:43.885655 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a863c3-9c2b-44e5-9060-90a8bc236e08 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:43.886198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a863c3-9c2b-44e5-9060-90a8bc236e08 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:43.886198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a863c3-9c2b-44e5-9060-90a8bc236e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:43.894421 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=69 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:25:43.907803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-97a863c3-9c2b-44e5-9060-90a8bc236e08 None None] MFA Rules not processed for user `3b58fad7b1e14a5f8c492a76a8840d44`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:43.909063 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-97a863c3-9c2b-44e5-9060-90a8bc236e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:43.917897 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 477/976] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 11 18:25:43 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:47.677052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac638-493c-4112-8f4d-5cbef83facdd None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:47.677052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac638-493c-4112-8f4d-5cbef83facdd None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:47.677052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac638-493c-4112-8f4d-5cbef83facdd None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:47.677860 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 500/977] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:47.679862 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa6b60-5888-479b-a58c-28d0ae566475 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:47.680647 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa6b60-5888-479b-a58c-28d0ae566475 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:47.681198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa6b60-5888-479b-a58c-28d0ae566475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:47.710763 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-96aa6b60-5888-479b-a58c-28d0ae566475 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:47.710763 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-96aa6b60-5888-479b-a58c-28d0ae566475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:47.718210 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 478/978] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:48.093129 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16c4f-b1ef-4cdd-a17b-2d9eca0c35c9 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:48.093791 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16c4f-b1ef-4cdd-a17b-2d9eca0c35c9 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:48.094290 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16c4f-b1ef-4cdd-a17b-2d9eca0c35c9 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:48.096355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 501/979] 10.222.0.15 () {54 vars in 962 bytes} [Thu Aug 11 18:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:48.104706 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e308aa-71a1-4281-94bd-d766eb5ea966 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:48.104874 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e308aa-71a1-4281-94bd-d766eb5ea966 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:48.105103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e308aa-71a1-4281-94bd-d766eb5ea966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:48.144784 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-80e308aa-71a1-4281-94bd-d766eb5ea966 None None] MFA Rules not processed for user `685c28640ca84d2b8e85d47e64430cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:48.146216 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-80e308aa-71a1-4281-94bd-d766eb5ea966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:48.224049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 479/980] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Aug 11 18:25:48 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:48.233037 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e16c4f-b1ef-4cdd-a17b-2d9eca0c35c9 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:48.249040 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e16c4f-b1ef-4cdd-a17b-2d9eca0c35c9 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:48.254614 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f1247-0da4-41ab-9606-bc84b415b8b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:48.255311 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f1247-0da4-41ab-9606-bc84b415b8b2 service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:48.255672 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f1247-0da4-41ab-9606-bc84b415b8b2 service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:48.256107 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f1247-0da4-41ab-9606-bc84b415b8b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:48.266006 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f1247-0da4-41ab-9606-bc84b415b8b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:48.267866 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f1247-0da4-41ab-9606-bc84b415b8b2 service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:48.278052 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 502/981] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 18:25:50.732487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068c18-777d-46e0-acbc-0892440c99c0 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:50.733122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068c18-777d-46e0-acbc-0892440c99c0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:50.733122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068c18-777d-46e0-acbc-0892440c99c0 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:50.734475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 480/982] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:50.740318 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0db10-b9bb-4031-83a7-734dbabfd2fe None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:50.741156 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0db10-b9bb-4031-83a7-734dbabfd2fe None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:50.741631 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0db10-b9bb-4031-83a7-734dbabfd2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:50.765800 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-d7d0db10-b9bb-4031-83a7-734dbabfd2fe None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:50.767078 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-d7d0db10-b9bb-4031-83a7-734dbabfd2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:50.775436 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 503/983] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:51.128962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068c18-777d-46e0-acbc-0892440c99c0 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:51.143041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068c18-777d-46e0-acbc-0892440c99c0 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:51.147848 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e5834-06d8-4a79-a5c2-39dd461c1739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:51.148442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5834-06d8-4a79-a5c2-39dd461c1739 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:51.148719 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5834-06d8-4a79-a5c2-39dd461c1739 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:51.148991 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5834-06d8-4a79-a5c2-39dd461c1739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:51.158091 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e5834-06d8-4a79-a5c2-39dd461c1739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:51.159700 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e5834-06d8-4a79-a5c2-39dd461c1739 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:51.170613 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 481/984] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:53.846755 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a418c-9cab-4b3c-b8fb-6fd0ef9fc992 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:53.847669 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a418c-9cab-4b3c-b8fb-6fd0ef9fc992 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:53.848197 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a418c-9cab-4b3c-b8fb-6fd0ef9fc992 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:53.849747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 504/985] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:53.855181 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd182-68e2-486b-adcc-57a6cb71b88f None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:53.855588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd182-68e2-486b-adcc-57a6cb71b88f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:53.855770 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd182-68e2-486b-adcc-57a6cb71b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:53.875850 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ba5dd182-68e2-486b-adcc-57a6cb71b88f None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:53.877051 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ba5dd182-68e2-486b-adcc-57a6cb71b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:53.884934 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 482/986] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:54.242790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e0c2-0785-4934-aac9-d03aa3a6ced8 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:54.243070 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e0c2-0785-4934-aac9-d03aa3a6ced8 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:54.243343 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e0c2-0785-4934-aac9-d03aa3a6ced8 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:54.244916 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 505/987] 10.222.0.15 () {54 vars in 962 bytes} [Thu Aug 11 18:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:54.251598 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af090b-46ce-4c50-8a4e-eb57b7be0193 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:54.252130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af090b-46ce-4c50-8a4e-eb57b7be0193 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:54.253041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af090b-46ce-4c50-8a4e-eb57b7be0193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:54.277334 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-74af090b-46ce-4c50-8a4e-eb57b7be0193 None None] MFA Rules not processed for user `685c28640ca84d2b8e85d47e64430cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:54.279258 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-74af090b-46ce-4c50-8a4e-eb57b7be0193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:54.292265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 483/988] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Aug 11 18:25:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:54.301527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66e0c2-0785-4934-aac9-d03aa3a6ced8 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:54.318542 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66e0c2-0785-4934-aac9-d03aa3a6ced8 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:54.327093 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969db4-a6b6-4f92-9536-00d65c4724c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:54.328008 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969db4-a6b6-4f92-9536-00d65c4724c9 service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:54.328482 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969db4-a6b6-4f92-9536-00d65c4724c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:54.328932 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969db4-a6b6-4f92-9536-00d65c4724c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:54.340132 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51969db4-a6b6-4f92-9536-00d65c4724c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:54.342027 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51969db4-a6b6-4f92-9536-00d65c4724c9 service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:54.353884 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 506/989] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:56.815944 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88a09a-f4c1-4a5c-9076-b02c4ce23784 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:56.816910 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88a09a-f4c1-4a5c-9076-b02c4ce23784 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:56.817569 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88a09a-f4c1-4a5c-9076-b02c4ce23784 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:56.824704 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f70b3-2858-4391-bac8-b4e4177dda9c None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:56.825577 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f70b3-2858-4391-bac8-b4e4177dda9c None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:56.826070 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f70b3-2858-4391-bac8-b4e4177dda9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:56.829135 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 484/990] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:56 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:56.846757 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-c14f70b3-2858-4391-bac8-b4e4177dda9c None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:56.848276 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-c14f70b3-2858-4391-bac8-b4e4177dda9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:56.863106 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 507/991] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:57.220443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88a09a-f4c1-4a5c-9076-b02c4ce23784 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:57.235176 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88a09a-f4c1-4a5c-9076-b02c4ce23784 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:57.240545 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa8e96-1085-4319-b3b1-a8929992429d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:57.243694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa8e96-1085-4319-b3b1-a8929992429d service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:57.243694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa8e96-1085-4319-b3b1-a8929992429d service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:57.243694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa8e96-1085-4319-b3b1-a8929992429d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:57.250703 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa8e96-1085-4319-b3b1-a8929992429d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:57.252234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa8e96-1085-4319-b3b1-a8929992429d service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:57.263384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 485/992] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:58.065745 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac853-8cfd-479a-b3c6-059ae6a03261 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:58.066251 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac853-8cfd-479a-b3c6-059ae6a03261 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:58.066251 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac853-8cfd-479a-b3c6-059ae6a03261 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:58.072770 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091853e-359a-47fd-90fd-93a8a2ad1ccc None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:58.074258 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091853e-359a-47fd-90fd-93a8a2ad1ccc None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:58.075460 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091853e-359a-47fd-90fd-93a8a2ad1ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:58.078409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 508/993] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:58.115285 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-4091853e-359a-47fd-90fd-93a8a2ad1ccc None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:58.118114 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-4091853e-359a-47fd-90fd-93a8a2ad1ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:58.153877 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 486/994] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:25:58.851379 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a11bd-fe38-41ab-b181-6ffdd49d790e None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:58.851658 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a11bd-fe38-41ab-b181-6ffdd49d790e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:58.851875 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a11bd-fe38-41ab-b181-6ffdd49d790e None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:58.853327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 509/995] 10.222.0.15 () {54 vars in 964 bytes} [Thu Aug 11 18:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:58.858884 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b4b2-3cae-442f-9e1c-18981ecbd6c0 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:58.859240 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b4b2-3cae-442f-9e1c-18981ecbd6c0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:58.859588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b4b2-3cae-442f-9e1c-18981ecbd6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:58.914248 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-32d2b4b2-3cae-442f-9e1c-18981ecbd6c0 None None] MFA Rules not processed for user `8f3f1554e540472ca6e38f65a1401d59`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:58.915742 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-32d2b4b2-3cae-442f-9e1c-18981ecbd6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:58.969750 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:25:58.980131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 487/996] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Aug 11 18:25:58 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:25:58.988540 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a11bd-fe38-41ab-b181-6ffdd49d790e None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:25:59.002743 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a11bd-fe38-41ab-b181-6ffdd49d790e None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:25:59.006745 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab07bbd-967f-485e-84c7-91a1d9ee680f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3f1554e540472ca6e38f65a1401d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:25:59.007444 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab07bbd-967f-485e-84c7-91a1d9ee680f service cinder] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:59.007795 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab07bbd-967f-485e-84c7-91a1d9ee680f service cinder] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:59.008140 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab07bbd-967f-485e-84c7-91a1d9ee680f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:59.019012 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab07bbd-967f-485e-84c7-91a1d9ee680f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:25:59.020566 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab07bbd-967f-485e-84c7-91a1d9ee680f service cinder] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:25:59.031560 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 510/997] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:25:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:25:59.827053 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62125362-7299-4baa-97ac-c4e40a88d4fa None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:59.827580 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62125362-7299-4baa-97ac-c4e40a88d4fa None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:59.827884 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62125362-7299-4baa-97ac-c4e40a88d4fa None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:59.835999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 488/998] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:25:59.837748 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c62ab-0558-4b5c-aba2-450cc5d54308 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:25:59.838292 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c62ab-0558-4b5c-aba2-450cc5d54308 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:25:59.838719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c62ab-0558-4b5c-aba2-450cc5d54308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:25:59.862588 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-944c62ab-0558-4b5c-aba2-450cc5d54308 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:25:59.864003 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-944c62ab-0558-4b5c-aba2-450cc5d54308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:25:59.873476 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 511/999] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:25:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:00.226187 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62125362-7299-4baa-97ac-c4e40a88d4fa None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:00.241318 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62125362-7299-4baa-97ac-c4e40a88d4fa None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:00.247285 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5ff0a-d675-4d53-a441-444325c18533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:00.247891 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5ff0a-d675-4d53-a441-444325c18533 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:00.248170 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5ff0a-d675-4d53-a441-444325c18533 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:00.248446 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5ff0a-d675-4d53-a441-444325c18533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:00.257334 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5ff0a-d675-4d53-a441-444325c18533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:00.258954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5ff0a-d675-4d53-a441-444325c18533 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:00.270221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 489/1000] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:02.675166 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af2b67-1abb-46ab-b348-e79143862589 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:02.675665 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af2b67-1abb-46ab-b348-e79143862589 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:02.675665 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af2b67-1abb-46ab-b348-e79143862589 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:02.676930 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 512/1001] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:02.682454 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75771-5f67-4f02-affc-e57f24edf993 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:02.682884 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75771-5f67-4f02-affc-e57f24edf993 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:02.683171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe75771-5f67-4f02-affc-e57f24edf993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:02.702929 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1fe75771-5f67-4f02-affc-e57f24edf993 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:02.704119 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1fe75771-5f67-4f02-affc-e57f24edf993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:02.711850 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 490/1002] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:26:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:26:03.066534 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af2b67-1abb-46ab-b348-e79143862589 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:03.086183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af2b67-1abb-46ab-b348-e79143862589 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:03.091724 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0620b-6ffd-4c10-96c4-33e45fc7578c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:03.093013 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0620b-6ffd-4c10-96c4-33e45fc7578c service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:03.093526 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0620b-6ffd-4c10-96c4-33e45fc7578c service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:03.094644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0620b-6ffd-4c10-96c4-33e45fc7578c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:03.104685 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0620b-6ffd-4c10-96c4-33e45fc7578c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:03.108091 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0620b-6ffd-4c10-96c4-33e45fc7578c service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:03.120650 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 513/1003] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:05.483198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcb21a-0514-403f-a3c1-99426acc0cc0 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:05.484202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcb21a-0514-403f-a3c1-99426acc0cc0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:05.484202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcb21a-0514-403f-a3c1-99426acc0cc0 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:05.485272 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 491/1004] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:05.490581 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1034ce5-4314-40a7-8022-1f6d1ead6a0d None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:05.491166 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1034ce5-4314-40a7-8022-1f6d1ead6a0d None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:05.491166 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1034ce5-4314-40a7-8022-1f6d1ead6a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:05.510226 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-a1034ce5-4314-40a7-8022-1f6d1ead6a0d None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:05.511434 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-a1034ce5-4314-40a7-8022-1f6d1ead6a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:05.531043 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 514/1005] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:26:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:05.877595 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcb21a-0514-403f-a3c1-99426acc0cc0 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:05.894294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcb21a-0514-403f-a3c1-99426acc0cc0 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:05.900593 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3a0ea-8477-4bdf-9ab6-7fd1d699b26b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:05.901588 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a0ea-8477-4bdf-9ab6-7fd1d699b26b service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:05.902054 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a0ea-8477-4bdf-9ab6-7fd1d699b26b service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:05.902518 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a0ea-8477-4bdf-9ab6-7fd1d699b26b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:05.914471 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3a0ea-8477-4bdf-9ab6-7fd1d699b26b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:05.916414 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3a0ea-8477-4bdf-9ab6-7fd1d699b26b service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:05.929570 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 492/1006] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:08.164475 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ba90-d702-46bb-ac9a-1736c134b01c None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:08.165071 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ba90-d702-46bb-ac9a-1736c134b01c None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:08.165071 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ba90-d702-46bb-ac9a-1736c134b01c None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:08.166330 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 515/1007] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:08.172387 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585274cf-c407-476f-976b-6a5e2b43f346 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:08.172820 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585274cf-c407-476f-976b-6a5e2b43f346 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:08.172932 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585274cf-c407-476f-976b-6a5e2b43f346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:08.196444 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-585274cf-c407-476f-976b-6a5e2b43f346 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:08.197917 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-585274cf-c407-476f-976b-6a5e2b43f346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:08.207461 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 493/1008] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:26:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:08.552666 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ba90-d702-46bb-ac9a-1736c134b01c None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:08.567160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ba90-d702-46bb-ac9a-1736c134b01c None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:08.572077 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c717c2-0762-4f4f-aa1d-fa5c19a79a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:08.572605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c717c2-0762-4f4f-aa1d-fa5c19a79a79 service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:08.572881 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c717c2-0762-4f4f-aa1d-fa5c19a79a79 service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:08.573154 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c717c2-0762-4f4f-aa1d-fa5c19a79a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:08.581496 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c717c2-0762-4f4f-aa1d-fa5c19a79a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:08.583108 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c717c2-0762-4f4f-aa1d-fa5c19a79a79 service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:08.592692 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 516/1009] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:11.220024 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47429cdf-1bc0-492e-92d8-797bcc00b1c9 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:11.220750 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47429cdf-1bc0-492e-92d8-797bcc00b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:11.220750 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47429cdf-1bc0-492e-92d8-797bcc00b1c9 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:11.221914 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 494/1010] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:11.227163 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63feba-2fa5-4f05-aebc-7c72413a6c85 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:11.227628 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63feba-2fa5-4f05-aebc-7c72413a6c85 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:11.227731 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63feba-2fa5-4f05-aebc-7c72413a6c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:11.248261 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-2a63feba-2fa5-4f05-aebc-7c72413a6c85 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:11.249501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-2a63feba-2fa5-4f05-aebc-7c72413a6c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:11.257232 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 517/1011] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:26:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:11.864029 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47429cdf-1bc0-492e-92d8-797bcc00b1c9 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:11.884961 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47429cdf-1bc0-492e-92d8-797bcc00b1c9 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:11.890297 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61631f-ec70-4d66-b59f-9aa27e0b1b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:11.890915 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61631f-ec70-4d66-b59f-9aa27e0b1b15 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:11.891192 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61631f-ec70-4d66-b59f-9aa27e0b1b15 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:11.891467 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61631f-ec70-4d66-b59f-9aa27e0b1b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:11.901544 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61631f-ec70-4d66-b59f-9aa27e0b1b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:11.903705 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61631f-ec70-4d66-b59f-9aa27e0b1b15 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:11.913564 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 495/1012] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:14.699401 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab7f15-cb20-4124-aadb-64a07152619a None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:14.700034 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab7f15-cb20-4124-aadb-64a07152619a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:14.700140 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab7f15-cb20-4124-aadb-64a07152619a None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:14.701994 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 518/1013] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:14.707376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a20d-cf00-4145-a1c5-e4f6e2b51226 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:14.707884 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a20d-cf00-4145-a1c5-e4f6e2b51226 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:14.708080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32a20d-cf00-4145-a1c5-e4f6e2b51226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:14.727475 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-bf32a20d-cf00-4145-a1c5-e4f6e2b51226 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:14.728677 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-bf32a20d-cf00-4145-a1c5-e4f6e2b51226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:14.736552 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 496/1014] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:26:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:15.087298 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab7f15-cb20-4124-aadb-64a07152619a None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:15.095109 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=46 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:26:15.101872 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab7f15-cb20-4124-aadb-64a07152619a None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:15.106888 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb620f-e052-4ab4-be60-3957fcc2c6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:15.107674 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb620f-e052-4ab4-be60-3957fcc2c6bf service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:15.107951 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb620f-e052-4ab4-be60-3957fcc2c6bf service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:15.108228 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb620f-e052-4ab4-be60-3957fcc2c6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:15.116786 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb620f-e052-4ab4-be60-3957fcc2c6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:15.118327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb620f-e052-4ab4-be60-3957fcc2c6bf service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:15.129068 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 519/1015] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:15.571871 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb465b-cac0-461a-acc5-6960c189c3df None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:15.572082 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb465b-cac0-461a-acc5-6960c189c3df None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:15.572339 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb465b-cac0-461a-acc5-6960c189c3df None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:15.573693 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 497/1016] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:15.579737 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff0b25-a6d3-4fc3-a51b-f39a8aa0f985 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:15.580024 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff0b25-a6d3-4fc3-a51b-f39a8aa0f985 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:15.580303 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff0b25-a6d3-4fc3-a51b-f39a8aa0f985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:15.599307 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-31ff0b25-a6d3-4fc3-a51b-f39a8aa0f985 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:15.600474 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-31ff0b25-a6d3-4fc3-a51b-f39a8aa0f985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:15.608424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 520/1017] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:26:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:15.970080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba5402-5eed-4840-bd40-3739e702d625 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:15.970566 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba5402-5eed-4840-bd40-3739e702d625 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:15.970709 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba5402-5eed-4840-bd40-3739e702d625 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:15.971962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 498/1018] 10.222.0.15 () {54 vars in 967 bytes} [Thu Aug 11 18:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:15.976834 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63795-88d3-4805-b36b-c89ebe2897bd None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:15.977254 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63795-88d3-4805-b36b-c89ebe2897bd None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:15.977510 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63795-88d3-4805-b36b-c89ebe2897bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:16.028006 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-7ca63795-88d3-4805-b36b-c89ebe2897bd None None] MFA Rules not processed for user `cc7c47252a3e4bc4b592475797aa202a`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:16.029200 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-7ca63795-88d3-4805-b36b-c89ebe2897bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:16.088116 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 521/1019] 10.222.0.15 () {58 vars in 1064 bytes} [Thu Aug 11 18:26:15 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:16.096085 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba5402-5eed-4840-bd40-3739e702d625 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:16.106370 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba5402-5eed-4840-bd40-3739e702d625 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:16.109864 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660b5b4-8dd5-4df8-96a9-76e6ab512a1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c47252a3e4bc4b592475797aa202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:16.110443 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660b5b4-8dd5-4df8-96a9-76e6ab512a1d service glance] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:16.110755 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660b5b4-8dd5-4df8-96a9-76e6ab512a1d service glance] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:16.111031 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660b5b4-8dd5-4df8-96a9-76e6ab512a1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:16.119903 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660b5b4-8dd5-4df8-96a9-76e6ab512a1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:16.121325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660b5b4-8dd5-4df8-96a9-76e6ab512a1d service glance] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:16.130428 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 499/1020] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:17.563112 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959eec1-39ec-480f-a8f1-bb15dddd3480 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:17.563720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959eec1-39ec-480f-a8f1-bb15dddd3480 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:17.563720 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959eec1-39ec-480f-a8f1-bb15dddd3480 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:17.565006 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 522/1021] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:17.570374 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d60e5-7fb8-4313-94f2-5bc03d4511f7 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:17.571234 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d60e5-7fb8-4313-94f2-5bc03d4511f7 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:17.571519 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d60e5-7fb8-4313-94f2-5bc03d4511f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:17.592182 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-7c4d60e5-7fb8-4313-94f2-5bc03d4511f7 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:17.593583 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-7c4d60e5-7fb8-4313-94f2-5bc03d4511f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:17.601483 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 500/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:26:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:17.973562 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959eec1-39ec-480f-a8f1-bb15dddd3480 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:17.988757 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959eec1-39ec-480f-a8f1-bb15dddd3480 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:17.994451 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068bc8e-378c-457f-897b-fae0c1000d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:17.995073 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068bc8e-378c-457f-897b-fae0c1000d1b service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:17.995349 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068bc8e-378c-457f-897b-fae0c1000d1b service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:17.995617 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068bc8e-378c-457f-897b-fae0c1000d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:18.009147 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068bc8e-378c-457f-897b-fae0c1000d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:18.010821 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068bc8e-378c-457f-897b-fae0c1000d1b service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:18.026967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 523/1023] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:20.410757 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86a53a-a892-45b5-8c99-12f0a2da88a8 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:20.411326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86a53a-a892-45b5-8c99-12f0a2da88a8 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:20.411326 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86a53a-a892-45b5-8c99-12f0a2da88a8 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:20.412562 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 501/1024] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:20.417644 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f031f-db01-49b1-af8d-35aa122e427e None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:20.418083 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f031f-db01-49b1-af8d-35aa122e427e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:20.418311 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f031f-db01-49b1-af8d-35aa122e427e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:20.443628 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-484f031f-db01-49b1-af8d-35aa122e427e None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:20.451064 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-484f031f-db01-49b1-af8d-35aa122e427e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:20.453423 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 524/1025] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:26:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:26:20.803752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86a53a-a892-45b5-8c99-12f0a2da88a8 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:20.821487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86a53a-a892-45b5-8c99-12f0a2da88a8 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:20.827617 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d93bb-199f-471f-9dd2-fb6ffbd53845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:20.828295 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d93bb-199f-471f-9dd2-fb6ffbd53845 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:20.828637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d93bb-199f-471f-9dd2-fb6ffbd53845 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:20.828972 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d93bb-199f-471f-9dd2-fb6ffbd53845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:20.838361 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d93bb-199f-471f-9dd2-fb6ffbd53845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:20.840118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d93bb-199f-471f-9dd2-fb6ffbd53845 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:20.850316 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 502/1026] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 18:26:30.437850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=55 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:26:30.845869 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=45 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:26:32.218790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b2224-bc8d-409a-b52a-0f3e0506d103 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:32.219352 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b2224-bc8d-409a-b52a-0f3e0506d103 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:32.219352 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b2224-bc8d-409a-b52a-0f3e0506d103 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:32.220590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 525/1027] 10.222.0.15 () {54 vars in 918 bytes} [Thu Aug 11 18:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:32.225697 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f706cb0-e9d5-42ce-8c7e-e082e0174f9c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:32.226130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f706cb0-e9d5-42ce-8c7e-e082e0174f9c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:32.226272 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f706cb0-e9d5-42ce-8c7e-e082e0174f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:32.245850 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-0f706cb0-e9d5-42ce-8c7e-e082e0174f9c None None] MFA Rules not processed for user `3b58fad7b1e14a5f8c492a76a8840d44`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:32.247097 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-0f706cb0-e9d5-42ce-8c7e-e082e0174f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:32.255664 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 503/1028] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Aug 11 18:26:32 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:26:32.269387 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c1471-3e45-44d9-86a6-a48606deb338 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:32.269671 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c1471-3e45-44d9-86a6-a48606deb338 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:32.269947 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c1471-3e45-44d9-86a6-a48606deb338 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:32.271275 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 526/1029] 10.222.0.15 () {54 vars in 918 bytes} [Thu Aug 11 18:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:32.275684 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce7ad-980e-4a7b-831c-1c75b99adcf1 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:32.275967 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce7ad-980e-4a7b-831c-1c75b99adcf1 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:32.276243 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce7ad-980e-4a7b-831c-1c75b99adcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:32.307517 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-864ce7ad-980e-4a7b-831c-1c75b99adcf1 None None] MFA Rules not processed for user `685c28640ca84d2b8e85d47e64430cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:32.308773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-864ce7ad-980e-4a7b-831c-1c75b99adcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:32.317352 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 504/1030] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Aug 11 18:26:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:26:35.007741 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2eff-d60a-40f0-9756-ecd3e527b422 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:35.008253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2eff-d60a-40f0-9756-ecd3e527b422 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:35.008253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda2eff-d60a-40f0-9756-ecd3e527b422 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:35.009508 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 527/1031] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:35.014928 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117b112-50c1-49ba-bfa1-7d0d26ef97d2 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:35.015352 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117b112-50c1-49ba-bfa1-7d0d26ef97d2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:35.015478 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117b112-50c1-49ba-bfa1-7d0d26ef97d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:35.035010 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1117b112-50c1-49ba-bfa1-7d0d26ef97d2 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:35.036202 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1117b112-50c1-49ba-bfa1-7d0d26ef97d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:35.043813 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 505/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:26:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:35.392446 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda2eff-d60a-40f0-9756-ecd3e527b422 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:35.406864 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda2eff-d60a-40f0-9756-ecd3e527b422 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:35.411690 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa26259-90e0-4b46-8b15-3e9fd0bcc4f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:35.412389 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa26259-90e0-4b46-8b15-3e9fd0bcc4f9 service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:35.412672 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa26259-90e0-4b46-8b15-3e9fd0bcc4f9 service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:35.412944 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa26259-90e0-4b46-8b15-3e9fd0bcc4f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:35.421026 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa26259-90e0-4b46-8b15-3e9fd0bcc4f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:35.422585 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa26259-90e0-4b46-8b15-3e9fd0bcc4f9 service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:35.431843 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 528/1033] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:36.398423 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73350a26-253b-4e0a-9dbd-cf170e3359b3 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:36.399007 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73350a26-253b-4e0a-9dbd-cf170e3359b3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:36.399007 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73350a26-253b-4e0a-9dbd-cf170e3359b3 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:36.400359 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 506/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:36.405227 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f922204-f338-49de-9448-46048a885e81 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:36.405669 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f922204-f338-49de-9448-46048a885e81 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:36.405786 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f922204-f338-49de-9448-46048a885e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:36.425114 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-0f922204-f338-49de-9448-46048a885e81 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:36.426293 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-0f922204-f338-49de-9448-46048a885e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:36.433903 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 529/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:26:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:36.627191 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73350a26-253b-4e0a-9dbd-cf170e3359b3 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:36.641003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73350a26-253b-4e0a-9dbd-cf170e3359b3 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:36.646150 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20173077-d2f3-423d-adcd-14b2d872f2f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:36.646773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20173077-d2f3-423d-adcd-14b2d872f2f1 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:36.647059 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20173077-d2f3-423d-adcd-14b2d872f2f1 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:36.647334 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20173077-d2f3-423d-adcd-14b2d872f2f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:36.655334 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20173077-d2f3-423d-adcd-14b2d872f2f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:36.656848 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20173077-d2f3-423d-adcd-14b2d872f2f1 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:36.666179 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 507/1036] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:37.567956 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c824-0e65-4332-ac1c-62100bb58800 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:37.568501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c824-0e65-4332-ac1c-62100bb58800 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:37.568501 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c824-0e65-4332-ac1c-62100bb58800 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:37.569817 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 530/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:37.574565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f41459-3215-438a-b040-1be87e661ac3 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:37.575023 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f41459-3215-438a-b040-1be87e661ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:37.575160 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f41459-3215-438a-b040-1be87e661ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:37.594652 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-01f41459-3215-438a-b040-1be87e661ac3 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:37.595869 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-01f41459-3215-438a-b040-1be87e661ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:37.603564 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 508/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:26:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:37.760503 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988c824-0e65-4332-ac1c-62100bb58800 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:37.774421 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988c824-0e65-4332-ac1c-62100bb58800 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:37.779404 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661898a-46e3-48dc-b0d4-d47ee03b1263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:37.780636 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661898a-46e3-48dc-b0d4-d47ee03b1263 service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:37.780891 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661898a-46e3-48dc-b0d4-d47ee03b1263 service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:37.781164 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661898a-46e3-48dc-b0d4-d47ee03b1263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:37.789269 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661898a-46e3-48dc-b0d4-d47ee03b1263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:37.790877 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661898a-46e3-48dc-b0d4-d47ee03b1263 service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:37.801355 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 531/1039] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:38.696553 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedb5e8-0370-43d5-96f8-86db8cb0b661 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:38.697204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedb5e8-0370-43d5-96f8-86db8cb0b661 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:38.697204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedb5e8-0370-43d5-96f8-86db8cb0b661 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:38.698473 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 509/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:38.703850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206feb4-1afa-44b1-af5c-061f2b1e995c None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:38.704309 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206feb4-1afa-44b1-af5c-061f2b1e995c None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:38.704415 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206feb4-1afa-44b1-af5c-061f2b1e995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:38.725076 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-8206feb4-1afa-44b1-af5c-061f2b1e995c None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:38.726253 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-8206feb4-1afa-44b1-af5c-061f2b1e995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:38.734097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 532/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:26:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:38.890609 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedb5e8-0370-43d5-96f8-86db8cb0b661 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:38.903722 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedb5e8-0370-43d5-96f8-86db8cb0b661 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:38.909127 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a13185-6e90-4698-ba0b-f93d5e2ecf93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:38.909715 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a13185-6e90-4698-ba0b-f93d5e2ecf93 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:38.909993 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a13185-6e90-4698-ba0b-f93d5e2ecf93 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:38.910265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a13185-6e90-4698-ba0b-f93d5e2ecf93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:38.918149 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a13185-6e90-4698-ba0b-f93d5e2ecf93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:38.919742 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a13185-6e90-4698-ba0b-f93d5e2ecf93 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:38.929745 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 510/1042] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 18:26:39.798367 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3ae98-3e5f-4e3c-85c8-970f761328b2 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:39.798915 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3ae98-3e5f-4e3c-85c8-970f761328b2 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:39.799028 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3ae98-3e5f-4e3c-85c8-970f761328b2 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:39.800301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 533/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:39.805097 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770faaf8-3269-4ce4-9dd1-567963c078e4 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:39.805540 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770faaf8-3269-4ce4-9dd1-567963c078e4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:39.805652 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770faaf8-3269-4ce4-9dd1-567963c078e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:39.825981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-770faaf8-3269-4ce4-9dd1-567963c078e4 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:39.827825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-770faaf8-3269-4ce4-9dd1-567963c078e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:39.835578 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 511/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:26:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:39.990747 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3ae98-3e5f-4e3c-85c8-970f761328b2 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:40.004541 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3ae98-3e5f-4e3c-85c8-970f761328b2 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:40.009360 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15d528-616c-4f8e-b81f-c056ab816146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:40.009939 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15d528-616c-4f8e-b81f-c056ab816146 service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:40.010217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15d528-616c-4f8e-b81f-c056ab816146 service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:40.010491 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15d528-616c-4f8e-b81f-c056ab816146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:40.018951 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15d528-616c-4f8e-b81f-c056ab816146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:40.020527 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15d528-616c-4f8e-b81f-c056ab816146 service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:40.029733 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 534/1045] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:40.903838 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d9294-ebb5-43fc-b182-faf0b3bbac11 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:40.904374 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d9294-ebb5-43fc-b182-faf0b3bbac11 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:40.904374 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d9294-ebb5-43fc-b182-faf0b3bbac11 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:40.906261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 512/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:40.911136 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4695c-3887-412d-930b-73c0f7b37100 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:40.911552 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4695c-3887-412d-930b-73c0f7b37100 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:40.911709 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4695c-3887-412d-930b-73c0f7b37100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:40.930641 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-8ff4695c-3887-412d-930b-73c0f7b37100 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:40.931850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-8ff4695c-3887-412d-930b-73c0f7b37100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:40.939676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 535/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:26:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:41.096266 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d9294-ebb5-43fc-b182-faf0b3bbac11 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:41.109916 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d9294-ebb5-43fc-b182-faf0b3bbac11 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:41.114911 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2da863-eca1-473d-bd9d-5853c1995e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:41.115756 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2da863-eca1-473d-bd9d-5853c1995e43 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:41.116039 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2da863-eca1-473d-bd9d-5853c1995e43 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:41.116315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2da863-eca1-473d-bd9d-5853c1995e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:41.124916 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2da863-eca1-473d-bd9d-5853c1995e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:41.126487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2da863-eca1-473d-bd9d-5853c1995e43 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:41.135744 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 513/1048] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:41.992296 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16a478-77cc-42d5-b9b6-6fa5634dd93e None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:41.992854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16a478-77cc-42d5-b9b6-6fa5634dd93e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:41.992854 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16a478-77cc-42d5-b9b6-6fa5634dd93e None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:41.994219 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 536/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:41.999241 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed0788-58c7-414c-8229-31c3ef4544f6 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:41.999672 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed0788-58c7-414c-8229-31c3ef4544f6 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:41.999785 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed0788-58c7-414c-8229-31c3ef4544f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:42.019003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-80ed0788-58c7-414c-8229-31c3ef4544f6 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:42.020204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-80ed0788-58c7-414c-8229-31c3ef4544f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:42.027994 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 514/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:26:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:42.185235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16a478-77cc-42d5-b9b6-6fa5634dd93e None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:42.199113 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16a478-77cc-42d5-b9b6-6fa5634dd93e None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:42.204075 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b36909-1133-4b21-880d-0eeda5e0f79a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:42.204664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b36909-1133-4b21-880d-0eeda5e0f79a service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:42.204946 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b36909-1133-4b21-880d-0eeda5e0f79a service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:42.205222 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b36909-1133-4b21-880d-0eeda5e0f79a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:42.213224 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b36909-1133-4b21-880d-0eeda5e0f79a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:42.214819 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b36909-1133-4b21-880d-0eeda5e0f79a service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:42.224088 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 537/1051] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:43.080345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0b669-0806-46f9-8e55-924a188791b5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:43.080850 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0b669-0806-46f9-8e55-924a188791b5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:43.080946 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0b669-0806-46f9-8e55-924a188791b5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:43.082243 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 515/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:26:43.087007 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954aac9-84e6-4941-83ca-32c7649e1efe None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:43.087441 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954aac9-84e6-4941-83ca-32c7649e1efe None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:43.087559 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954aac9-84e6-4941-83ca-32c7649e1efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:43.107334 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-2954aac9-84e6-4941-83ca-32c7649e1efe None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:43.108659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-2954aac9-84e6-4941-83ca-32c7649e1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:43.116599 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 538/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:26:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:43.271560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0b669-0806-46f9-8e55-924a188791b5 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:43.285222 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0b669-0806-46f9-8e55-924a188791b5 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:43.289982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942fe3a-58ef-4c21-b218-86be25e3b603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:43.290566 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942fe3a-58ef-4c21-b218-86be25e3b603 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:43.290871 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942fe3a-58ef-4c21-b218-86be25e3b603 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:43.291140 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942fe3a-58ef-4c21-b218-86be25e3b603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:43.299540 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942fe3a-58ef-4c21-b218-86be25e3b603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:43.301116 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942fe3a-58ef-4c21-b218-86be25e3b603 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:43.310752 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 516/1054] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:44.221799 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ce78-15e1-4f86-bc78-cde2978beb8e None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:44.222331 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ce78-15e1-4f86-bc78-cde2978beb8e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:44.222331 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4ce78-15e1-4f86-bc78-cde2978beb8e None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:44.223653 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 539/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:44.228407 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43770ee-ad13-4234-bc48-d37528631c07 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:44.228825 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43770ee-ad13-4234-bc48-d37528631c07 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:44.228956 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43770ee-ad13-4234-bc48-d37528631c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:44.253126 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c43770ee-ad13-4234-bc48-d37528631c07 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:44.254325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c43770ee-ad13-4234-bc48-d37528631c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:44.261968 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 517/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:26:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:44.425185 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4ce78-15e1-4f86-bc78-cde2978beb8e None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:44.439231 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4ce78-15e1-4f86-bc78-cde2978beb8e None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:44.444105 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb819-9be8-425d-8bba-a86066f94340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:44.449639 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb819-9be8-425d-8bba-a86066f94340 service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:44.449639 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb819-9be8-425d-8bba-a86066f94340 service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:44.449639 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb819-9be8-425d-8bba-a86066f94340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:44.453432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcb819-9be8-425d-8bba-a86066f94340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:44.455034 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcb819-9be8-425d-8bba-a86066f94340 service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:44.464261 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 540/1057] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:46.524779 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785199af-b1d3-43bc-9b02-35dc24bb20c5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:46.525315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785199af-b1d3-43bc-9b02-35dc24bb20c5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:46.525315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785199af-b1d3-43bc-9b02-35dc24bb20c5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:46.526708 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 518/1058] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:46.532002 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ba4ff-0476-4739-a331-920b28295e47 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:46.532432 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ba4ff-0476-4739-a331-920b28295e47 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:46.532541 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ba4ff-0476-4739-a331-920b28295e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:46.551399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-253ba4ff-0476-4739-a331-920b28295e47 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:46.552573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-253ba4ff-0476-4739-a331-920b28295e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:46.560131 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 541/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:26:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:46.903876 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785199af-b1d3-43bc-9b02-35dc24bb20c5 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:46.915222 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785199af-b1d3-43bc-9b02-35dc24bb20c5 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:46.918919 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03ea6b-9d92-4977-8d56-2692f4cf2d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:46.919517 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03ea6b-9d92-4977-8d56-2692f4cf2d39 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:46.919799 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03ea6b-9d92-4977-8d56-2692f4cf2d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:46.920075 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03ea6b-9d92-4977-8d56-2692f4cf2d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:46.929015 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03ea6b-9d92-4977-8d56-2692f4cf2d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:46.930429 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03ea6b-9d92-4977-8d56-2692f4cf2d39 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:46.939878 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 519/1060] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:49.267762 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd41ee3-4c2a-45b5-98c2-14e5691b89b6 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:49.268340 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd41ee3-4c2a-45b5-98c2-14e5691b89b6 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:49.268340 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd41ee3-4c2a-45b5-98c2-14e5691b89b6 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:49.269633 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 542/1061] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:49.274755 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5155c4-30d1-4eab-909d-13a1782f04af None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:49.275193 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5155c4-30d1-4eab-909d-13a1782f04af None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:49.275300 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5155c4-30d1-4eab-909d-13a1782f04af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:49.294999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6e5155c4-30d1-4eab-909d-13a1782f04af None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:49.296135 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6e5155c4-30d1-4eab-909d-13a1782f04af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:49.303807 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 520/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:26:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:49.643936 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd41ee3-4c2a-45b5-98c2-14e5691b89b6 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:49.654514 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd41ee3-4c2a-45b5-98c2-14e5691b89b6 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:49.658013 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0107b-84c2-4620-b7fe-dc16a04ddab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:49.658596 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0107b-84c2-4620-b7fe-dc16a04ddab6 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:49.658919 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0107b-84c2-4620-b7fe-dc16a04ddab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:49.659191 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0107b-84c2-4620-b7fe-dc16a04ddab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:49.667992 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0107b-84c2-4620-b7fe-dc16a04ddab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:49.669438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0107b-84c2-4620-b7fe-dc16a04ddab6 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:49.679270 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 543/1063] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:52.229449 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644180c-f951-40e2-acf5-e27a2afe6535 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:52.229962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644180c-f951-40e2-acf5-e27a2afe6535 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:52.229962 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644180c-f951-40e2-acf5-e27a2afe6535 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:52.231273 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 521/1064] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:52.236411 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719bf1c-72db-458f-875a-cdfdab258a40 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:52.236823 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719bf1c-72db-458f-875a-cdfdab258a40 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:52.236963 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719bf1c-72db-458f-875a-cdfdab258a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:52.255799 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-4719bf1c-72db-458f-875a-cdfdab258a40 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:52.256988 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-4719bf1c-72db-458f-875a-cdfdab258a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:52.265700 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 544/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:26:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:52.603946 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644180c-f951-40e2-acf5-e27a2afe6535 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:52.614583 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644180c-f951-40e2-acf5-e27a2afe6535 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:52.618270 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a03b65-002f-4a96-8709-bb9d7971782a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:52.618878 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03b65-002f-4a96-8709-bb9d7971782a service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:52.619154 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03b65-002f-4a96-8709-bb9d7971782a service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:52.619420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03b65-002f-4a96-8709-bb9d7971782a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:52.628821 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a03b65-002f-4a96-8709-bb9d7971782a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:52.630301 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a03b65-002f-4a96-8709-bb9d7971782a service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:52.640582 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 522/1066] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:55.015668 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156a00-8978-458b-b4a5-14fc1e0a25b3 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:55.016194 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156a00-8978-458b-b4a5-14fc1e0a25b3 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:55.016194 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156a00-8978-458b-b4a5-14fc1e0a25b3 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:55.017448 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 545/1067] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:55.022645 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9b89-0969-458b-a6c4-7fc0c1c0f8a9 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:55.027033 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9b89-0969-458b-a6c4-7fc0c1c0f8a9 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:55.027033 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9b89-0969-458b-a6c4-7fc0c1c0f8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:55.042518 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-e0ae9b89-0969-458b-a6c4-7fc0c1c0f8a9 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:55.043758 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-e0ae9b89-0969-458b-a6c4-7fc0c1c0f8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:55.051772 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 523/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:26:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:55.391076 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156a00-8978-458b-b4a5-14fc1e0a25b3 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:55.401719 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156a00-8978-458b-b4a5-14fc1e0a25b3 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:55.409704 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74cde7-4978-411c-aad9-d1f47c116727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:55.410305 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74cde7-4978-411c-aad9-d1f47c116727 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:55.410564 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74cde7-4978-411c-aad9-d1f47c116727 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:55.410923 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74cde7-4978-411c-aad9-d1f47c116727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:55.423068 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74cde7-4978-411c-aad9-d1f47c116727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:55.424478 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74cde7-4978-411c-aad9-d1f47c116727 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:55.433649 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 546/1069] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:26:57.752294 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280a35-512c-4afd-aab5-e960b5ece774 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:57.752778 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280a35-512c-4afd-aab5-e960b5ece774 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:57.753325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280a35-512c-4afd-aab5-e960b5ece774 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:57.754177 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 524/1070] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:26:57.759739 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24371ef8-ae3d-4644-b56f-8c55cf3026e5 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:57.760185 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24371ef8-ae3d-4644-b56f-8c55cf3026e5 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:57.760280 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24371ef8-ae3d-4644-b56f-8c55cf3026e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:57.780668 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-24371ef8-ae3d-4644-b56f-8c55cf3026e5 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:26:57.781961 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-24371ef8-ae3d-4644-b56f-8c55cf3026e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:26:57.789801 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 547/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:26:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:26:58.144609 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78280a35-512c-4afd-aab5-e960b5ece774 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:26:58.155930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78280a35-512c-4afd-aab5-e960b5ece774 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:26:58.159466 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01aaa6-c0f6-40e1-8baa-f9f878087ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:26:58.160055 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01aaa6-c0f6-40e1-8baa-f9f878087ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:26:58.160336 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01aaa6-c0f6-40e1-8baa-f9f878087ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:26:58.160606 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01aaa6-c0f6-40e1-8baa-f9f878087ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:26:58.169445 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01aaa6-c0f6-40e1-8baa-f9f878087ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:26:58.171478 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01aaa6-c0f6-40e1-8baa-f9f878087ec4 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:26:58.180700 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 525/1072] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:26:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:27:00.440896 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed125824-1aff-45a9-9e41-39bcb82bcdd2 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:00.441461 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed125824-1aff-45a9-9e41-39bcb82bcdd2 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:00.441461 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed125824-1aff-45a9-9e41-39bcb82bcdd2 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:00.442782 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 548/1073] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:00.447911 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5f22-7038-4102-95a0-5f3dec0e66d1 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:00.448311 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5f22-7038-4102-95a0-5f3dec0e66d1 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:00.448470 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5f22-7038-4102-95a0-5f3dec0e66d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:00.469246 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-673a5f22-7038-4102-95a0-5f3dec0e66d1 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:00.470445 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-673a5f22-7038-4102-95a0-5f3dec0e66d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:00.478209 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 526/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:27:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:27:00.832130 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed125824-1aff-45a9-9e41-39bcb82bcdd2 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:00.837505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=64 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:27:00.843265 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed125824-1aff-45a9-9e41-39bcb82bcdd2 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:00.846922 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb97f8-ff85-4eeb-a16f-84c0b69be48c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:00.847502 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb97f8-ff85-4eeb-a16f-84c0b69be48c service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:00.847780 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb97f8-ff85-4eeb-a16f-84c0b69be48c service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:00.848056 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb97f8-ff85-4eeb-a16f-84c0b69be48c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:00.857368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb97f8-ff85-4eeb-a16f-84c0b69be48c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:00.858864 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb97f8-ff85-4eeb-a16f-84c0b69be48c service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:00.868529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 549/1075] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:27:03.097106 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a759f-28e1-4ddb-815d-15910f8a1af7 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:03.097638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a759f-28e1-4ddb-815d-15910f8a1af7 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:03.097638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a759f-28e1-4ddb-815d-15910f8a1af7 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:03.099028 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 527/1076] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:03.104223 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0bd5-7767-4937-acc8-b60ab6c7dce7 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:03.104600 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0bd5-7767-4937-acc8-b60ab6c7dce7 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:03.104779 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a0bd5-7767-4937-acc8-b60ab6c7dce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:03.124409 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-a73a0bd5-7767-4937-acc8-b60ab6c7dce7 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:03.125616 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-a73a0bd5-7767-4937-acc8-b60ab6c7dce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:03.133387 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 550/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:27:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:27:03.474401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a759f-28e1-4ddb-815d-15910f8a1af7 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:03.479838 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=78 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:27:03.486380 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a759f-28e1-4ddb-815d-15910f8a1af7 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:03.489904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27232184-e905-4874-8091-25d264cd1208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:03.493701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232184-e905-4874-8091-25d264cd1208 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:03.493701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232184-e905-4874-8091-25d264cd1208 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:03.493701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232184-e905-4874-8091-25d264cd1208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:03.500772 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27232184-e905-4874-8091-25d264cd1208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:03.502185 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27232184-e905-4874-8091-25d264cd1208 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:03.511581 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 528/1078] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:27:05.796688 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceeabf-924e-41d2-a78c-06c08220378b None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:05.797255 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceeabf-924e-41d2-a78c-06c08220378b None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:05.797255 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceeabf-924e-41d2-a78c-06c08220378b None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:05.798552 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 551/1079] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:05.803661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36b623-bcfb-41cd-8c57-e2ba4fc3a48c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:05.804096 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36b623-bcfb-41cd-8c57-e2ba4fc3a48c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:05.804241 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36b623-bcfb-41cd-8c57-e2ba4fc3a48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:05.822916 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-3f36b623-bcfb-41cd-8c57-e2ba4fc3a48c None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:05.824113 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-3f36b623-bcfb-41cd-8c57-e2ba4fc3a48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:05.832048 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 529/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:27:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:27:06.170260 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceeabf-924e-41d2-a78c-06c08220378b None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:06.181184 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceeabf-924e-41d2-a78c-06c08220378b None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:06.184612 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57977a04-7aa5-4a3f-990e-f981020434dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:06.185188 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57977a04-7aa5-4a3f-990e-f981020434dd service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:06.185462 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57977a04-7aa5-4a3f-990e-f981020434dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:06.185730 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57977a04-7aa5-4a3f-990e-f981020434dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:06.194948 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57977a04-7aa5-4a3f-990e-f981020434dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:06.196352 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57977a04-7aa5-4a3f-990e-f981020434dd service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:06.205837 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 552/1081] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:27:08.470805 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6df5d-2ba0-40db-baed-8b643033c2cd None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:08.471376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6df5d-2ba0-40db-baed-8b643033c2cd None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:08.471376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6df5d-2ba0-40db-baed-8b643033c2cd None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:08.472693 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 530/1082] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:08.477877 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80cbe-f5a1-4022-b6aa-3523ba73c46a None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:08.478287 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80cbe-f5a1-4022-b6aa-3523ba73c46a None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:08.478424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80cbe-f5a1-4022-b6aa-3523ba73c46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:08.498371 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-96b80cbe-f5a1-4022-b6aa-3523ba73c46a None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:08.500680 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-96b80cbe-f5a1-4022-b6aa-3523ba73c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:08.508183 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 553/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:27:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:27:08.856711 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6df5d-2ba0-40db-baed-8b643033c2cd None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:08.868306 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6df5d-2ba0-40db-baed-8b643033c2cd None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:08.871753 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd7537-a6ab-47ee-b80f-776e18a9a6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:08.872345 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd7537-a6ab-47ee-b80f-776e18a9a6de service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:08.872616 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd7537-a6ab-47ee-b80f-776e18a9a6de service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:08.872887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd7537-a6ab-47ee-b80f-776e18a9a6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:08.881670 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd7537-a6ab-47ee-b80f-776e18a9a6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:08.885696 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd7537-a6ab-47ee-b80f-776e18a9a6de service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:08.892281 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 531/1084] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:27:11.085715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ca8d8-a3cf-4367-b48f-273b795474f5 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:11.086228 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ca8d8-a3cf-4367-b48f-273b795474f5 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:11.086338 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ca8d8-a3cf-4367-b48f-273b795474f5 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:11.087620 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 554/1085] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:11.092787 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b6e0-d6ec-4f37-8211-dcaff6d0f6d4 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:11.093181 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b6e0-d6ec-4f37-8211-dcaff6d0f6d4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:11.093342 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126b6e0-d6ec-4f37-8211-dcaff6d0f6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:11.112218 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-7126b6e0-d6ec-4f37-8211-dcaff6d0f6d4 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:11.113572 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-7126b6e0-d6ec-4f37-8211-dcaff6d0f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:11.121537 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 532/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:27:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:27:11.460808 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ca8d8-a3cf-4367-b48f-273b795474f5 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:11.471365 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ca8d8-a3cf-4367-b48f-273b795474f5 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:11.474763 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49644468-2d6f-462b-9f2e-7ad5fb0272bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:11.475343 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49644468-2d6f-462b-9f2e-7ad5fb0272bf service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:11.475618 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49644468-2d6f-462b-9f2e-7ad5fb0272bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:11.475887 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49644468-2d6f-462b-9f2e-7ad5fb0272bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:11.484956 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49644468-2d6f-462b-9f2e-7ad5fb0272bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:11.486347 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49644468-2d6f-462b-9f2e-7ad5fb0272bf service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:11.495700 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 555/1087] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:27:21.107306 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=17 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:27:21.491735 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=23 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:27:35.434773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e342-a800-479a-a1fa-e0134a352409 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:35.435297 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e342-a800-479a-a1fa-e0134a352409 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:35.435297 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e342-a800-479a-a1fa-e0134a352409 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:35.436611 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 533/1088] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:35.441954 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe200a63-ff87-4829-bbd0-11045d695069 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:35.442413 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe200a63-ff87-4829-bbd0-11045d695069 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:35.442509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe200a63-ff87-4829-bbd0-11045d695069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:35.461421 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-fe200a63-ff87-4829-bbd0-11045d695069 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:35.462595 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-fe200a63-ff87-4829-bbd0-11045d695069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:35.471197 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 556/1089] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:27:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:27:35.832014 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b091f-e86b-45f0-bd09-0276dc989f18 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:35.832300 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b091f-e86b-45f0-bd09-0276dc989f18 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:35.832577 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b091f-e86b-45f0-bd09-0276dc989f18 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:35.833901 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 534/1090] 10.222.0.15 () {54 vars in 967 bytes} [Thu Aug 11 18:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:35.839346 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bae41-7c46-4869-9e0c-ce318cd25dc8 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:35.839630 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bae41-7c46-4869-9e0c-ce318cd25dc8 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:35.839902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bae41-7c46-4869-9e0c-ce318cd25dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:35.859154 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-831bae41-7c46-4869-9e0c-ce318cd25dc8 None None] MFA Rules not processed for user `cc7c47252a3e4bc4b592475797aa202a`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:35.860324 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-831bae41-7c46-4869-9e0c-ce318cd25dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:35.866552 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 557/1091] 10.222.0.15 () {58 vars in 1064 bytes} [Thu Aug 11 18:27:35 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:27:35.874545 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b091f-e86b-45f0-bd09-0276dc989f18 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:35.884920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b091f-e86b-45f0-bd09-0276dc989f18 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:35.888389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6e611-2c21-4892-bdc1-939e4abab3cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c47252a3e4bc4b592475797aa202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:35.888967 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e611-2c21-4892-bdc1-939e4abab3cf service glance] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:35.889950 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e611-2c21-4892-bdc1-939e4abab3cf service glance] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:35.890084 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e611-2c21-4892-bdc1-939e4abab3cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:35.898973 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6e611-2c21-4892-bdc1-939e4abab3cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:35.900390 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6e611-2c21-4892-bdc1-939e4abab3cf service glance] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:35.909838 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 535/1092] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 18:27:38.174553 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3b25-28ec-44e0-b87c-57986268ac8e None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:38.175117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3b25-28ec-44e0-b87c-57986268ac8e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:38.175117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3b25-28ec-44e0-b87c-57986268ac8e None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:38.176368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 558/1093] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:38.181766 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9719d0-bbbf-463e-9bce-4b89249d9416 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:38.182173 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9719d0-bbbf-463e-9bce-4b89249d9416 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:38.182312 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9719d0-bbbf-463e-9bce-4b89249d9416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:38.201411 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ec9719d0-bbbf-463e-9bce-4b89249d9416 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:38.203222 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ec9719d0-bbbf-463e-9bce-4b89249d9416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:38.210995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 536/1094] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:27:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:27:38.539436 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f3b25-28ec-44e0-b87c-57986268ac8e None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:38.552336 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f3b25-28ec-44e0-b87c-57986268ac8e None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:38.556750 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457fac2-d7bf-4348-9d04-8235af80e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:38.557335 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457fac2-d7bf-4348-9d04-8235af80e137 admin admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:38.557616 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457fac2-d7bf-4348-9d04-8235af80e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:38.557893 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457fac2-d7bf-4348-9d04-8235af80e137 admin admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:38.558647 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457fac2-d7bf-4348-9d04-8235af80e137 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:38.560419 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: WARNING py.warnings [None req-8457fac2-d7bf-4348-9d04-8235af80e137 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:27:38.560419 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: warnings.warn(msg) Aug 11 18:27:38.560419 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: Aug 11 18:27:38.562281 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457fac2-d7bf-4348-9d04-8235af80e137 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:38.579964 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 559/1095] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Aug 11 18:27:38 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:27:40.784559 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605ea05-97c7-4ee3-a2cc-8c7462a0aa1e None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:40.785115 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605ea05-97c7-4ee3-a2cc-8c7462a0aa1e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:40.785115 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605ea05-97c7-4ee3-a2cc-8c7462a0aa1e None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:40.786454 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 537/1096] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:40.791816 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933849d2-42ca-492a-af4a-6a9e73d68f07 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:40.792275 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933849d2-42ca-492a-af4a-6a9e73d68f07 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:40.792380 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933849d2-42ca-492a-af4a-6a9e73d68f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:40.811944 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-933849d2-42ca-492a-af4a-6a9e73d68f07 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:40.813188 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-933849d2-42ca-492a-af4a-6a9e73d68f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:40.821050 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 560/1097] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:27:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:27:41.169674 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605ea05-97c7-4ee3-a2cc-8c7462a0aa1e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:41.183027 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605ea05-97c7-4ee3-a2cc-8c7462a0aa1e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:41.188420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12cd6d-8771-4727-b720-3afe3ae0f8dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:41.192845 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12cd6d-8771-4727-b720-3afe3ae0f8dc service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:41.192845 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12cd6d-8771-4727-b720-3afe3ae0f8dc service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:41.192845 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12cd6d-8771-4727-b720-3afe3ae0f8dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:41.197605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12cd6d-8771-4727-b720-3afe3ae0f8dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:41.199242 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12cd6d-8771-4727-b720-3afe3ae0f8dc service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:41.209109 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 538/1098] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:27:43.531977 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dbbbc-b74d-4b5f-a3e9-04c9da472767 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:43.532533 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dbbbc-b74d-4b5f-a3e9-04c9da472767 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:43.532533 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dbbbc-b74d-4b5f-a3e9-04c9da472767 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:43.533890 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 561/1099] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:43.538943 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22599645-f656-436b-a33e-8e487a7e86d4 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:43.539337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22599645-f656-436b-a33e-8e487a7e86d4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:43.539487 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22599645-f656-436b-a33e-8e487a7e86d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:43.558724 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-22599645-f656-436b-a33e-8e487a7e86d4 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:43.559898 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-22599645-f656-436b-a33e-8e487a7e86d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:43.567552 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 539/1100] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:27:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:27:43.905717 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dbbbc-b74d-4b5f-a3e9-04c9da472767 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:43.916453 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dbbbc-b74d-4b5f-a3e9-04c9da472767 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:43.919975 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0a43-f98a-4d62-afd5-5fc80f6e061d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:43.920599 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0a43-f98a-4d62-afd5-5fc80f6e061d service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:43.921011 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0a43-f98a-4d62-afd5-5fc80f6e061d service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:43.921284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0a43-f98a-4d62-afd5-5fc80f6e061d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:43.930333 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a0a43-f98a-4d62-afd5-5fc80f6e061d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:43.931802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a0a43-f98a-4d62-afd5-5fc80f6e061d service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:43.941604 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 562/1101] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:27:46.174878 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09ad5-9249-42b8-80bc-b479e2d6ca05 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:46.175400 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09ad5-9249-42b8-80bc-b479e2d6ca05 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:46.175400 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09ad5-9249-42b8-80bc-b479e2d6ca05 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:46.176684 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 540/1102] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:46.181786 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3ce46-cd30-4d32-9c39-11456a7d8dfe None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:46.182206 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3ce46-cd30-4d32-9c39-11456a7d8dfe None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:46.182339 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3ce46-cd30-4d32-9c39-11456a7d8dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:46.202790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-49e3ce46-cd30-4d32-9c39-11456a7d8dfe None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:46.203980 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-49e3ce46-cd30-4d32-9c39-11456a7d8dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:46.211727 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 563/1103] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:27:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:27:46.556647 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a09ad5-9249-42b8-80bc-b479e2d6ca05 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:46.567492 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a09ad5-9249-42b8-80bc-b479e2d6ca05 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:46.570969 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669f66-4813-4166-9733-ce0de92916d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:46.571557 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669f66-4813-4166-9733-ce0de92916d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:46.571835 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669f66-4813-4166-9733-ce0de92916d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:46.572105 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669f66-4813-4166-9733-ce0de92916d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:46.580793 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74669f66-4813-4166-9733-ce0de92916d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:46.582221 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74669f66-4813-4166-9733-ce0de92916d9 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:46.591431 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 541/1104] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:27:48.924651 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474326-e46e-4763-bc07-85d436a69cd5 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:48.925215 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474326-e46e-4763-bc07-85d436a69cd5 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:48.925215 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474326-e46e-4763-bc07-85d436a69cd5 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:48.926522 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 564/1105] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:48.931765 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f77d4-7084-4902-9e9a-a35b28ecee5c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:48.932189 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f77d4-7084-4902-9e9a-a35b28ecee5c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:48.932312 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f77d4-7084-4902-9e9a-a35b28ecee5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:48.951171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f76f77d4-7084-4902-9e9a-a35b28ecee5c None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:48.952865 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f76f77d4-7084-4902-9e9a-a35b28ecee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:48.960777 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 542/1106] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:27:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:27:49.310482 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474326-e46e-4763-bc07-85d436a69cd5 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:49.321858 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474326-e46e-4763-bc07-85d436a69cd5 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:49.325271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e15a08-c21a-44c8-824f-f9da350d2343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:49.325859 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e15a08-c21a-44c8-824f-f9da350d2343 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:49.326137 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e15a08-c21a-44c8-824f-f9da350d2343 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:49.326407 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e15a08-c21a-44c8-824f-f9da350d2343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:49.336688 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e15a08-c21a-44c8-824f-f9da350d2343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:49.340426 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e15a08-c21a-44c8-824f-f9da350d2343 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:49.347914 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 565/1107] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:27:51.872899 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad054a98-80cb-446a-a53d-136767df8eda None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:51.873470 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad054a98-80cb-446a-a53d-136767df8eda None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:51.873470 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad054a98-80cb-446a-a53d-136767df8eda None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:51.875277 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 543/1108] 10.222.0.15 () {54 vars in 927 bytes} [Thu Aug 11 18:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:27:51.880471 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbde102-2bc6-4408-a69e-bfb2946eb6f5 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:51.880929 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbde102-2bc6-4408-a69e-bfb2946eb6f5 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:51.881040 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbde102-2bc6-4408-a69e-bfb2946eb6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:51.900630 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-8dbde102-2bc6-4408-a69e-bfb2946eb6f5 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:27:51.901848 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-8dbde102-2bc6-4408-a69e-bfb2946eb6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:27:51.910310 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 566/1109] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Aug 11 18:27:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:27:52.257599 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad054a98-80cb-446a-a53d-136767df8eda None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:27:52.268549 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad054a98-80cb-446a-a53d-136767df8eda None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:27:52.272054 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e9a7d-1936-4687-bf08-4916d9a3e38f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:27:52.272638 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e9a7d-1936-4687-bf08-4916d9a3e38f service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:27:52.272920 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e9a7d-1936-4687-bf08-4916d9a3e38f service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:27:52.273193 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e9a7d-1936-4687-bf08-4916d9a3e38f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:27:52.282539 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e9a7d-1936-4687-bf08-4916d9a3e38f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:27:52.283992 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e9a7d-1936-4687-bf08-4916d9a3e38f service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:27:52.293271 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 544/1110] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:27:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:28:01.895899 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=33 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:28:02.289269 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=33 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:29:21.482562 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5c3ec-d829-4d88-939d-62ad59340e86 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:21.487573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5c3ec-d829-4d88-939d-62ad59340e86 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:21.487573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5c3ec-d829-4d88-939d-62ad59340e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:21.503283 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-f2c5c3ec-d829-4d88-939d-62ad59340e86 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:29:21.510259 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-f2c5c3ec-d829-4d88-939d-62ad59340e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:29:21.512427 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 567/1111] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:29:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:29:21.520982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e04ad-d868-4961-aeb5-ad6f8b64a1cb None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:21.521565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e04ad-d868-4961-aeb5-ad6f8b64a1cb None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:21.521565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e04ad-d868-4961-aeb5-ad6f8b64a1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:21.540713 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6a9e04ad-d868-4961-aeb5-ad6f8b64a1cb None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:29:21.542263 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6a9e04ad-d868-4961-aeb5-ad6f8b64a1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:29:21.549846 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 545/1112] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:29:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:29:21.554360 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5c3ec-d829-4d88-939d-62ad59340e86 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:29:21.564160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5c3ec-d829-4d88-939d-62ad59340e86 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:29:21.569424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48aa45-b66f-4295-8abe-0df58df3a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:29:21.570019 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48aa45-b66f-4295-8abe-0df58df3a3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:21.570295 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48aa45-b66f-4295-8abe-0df58df3a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:21.570588 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48aa45-b66f-4295-8abe-0df58df3a3d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:21.571235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48aa45-b66f-4295-8abe-0df58df3a3d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:29:21.571573 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48aa45-b66f-4295-8abe-0df58df3a3d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:29:21.572602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: WARNING py.warnings [None req-3d48aa45-b66f-4295-8abe-0df58df3a3d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:29:21.572602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: warnings.warn(msg) Aug 11 18:29:21.572602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: Aug 11 18:29:21.573536 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48aa45-b66f-4295-8abe-0df58df3a3d6 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:29:21.586365 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 568/1113] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 11 18:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:29:21.594509 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e04ad-d868-4961-aeb5-ad6f8b64a1cb None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:29:21.603964 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e04ad-d868-4961-aeb5-ad6f8b64a1cb None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:29:21.608565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8681ddf-a447-40c4-8212-6ed2a131ac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:29:21.609164 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8681ddf-a447-40c4-8212-6ed2a131ac88 admin admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:21.609442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8681ddf-a447-40c4-8212-6ed2a131ac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:21.609715 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8681ddf-a447-40c4-8212-6ed2a131ac88 admin admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:21.610342 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8681ddf-a447-40c4-8212-6ed2a131ac88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:29:21.612263 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-a8681ddf-a447-40c4-8212-6ed2a131ac88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:29:21.612263 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Aug 11 18:29:21.612263 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: Aug 11 18:29:21.613466 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8681ddf-a447-40c4-8212-6ed2a131ac88 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:29:21.743312 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 546/1114] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 11 18:29:21 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:29:21.746044 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48aa45-b66f-4295-8abe-0df58df3a3d6 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:29:21.756528 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48aa45-b66f-4295-8abe-0df58df3a3d6 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:29:21.819374 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15db26-d4a1-4a89-9ebd-242b15122269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:29:21.820004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15db26-d4a1-4a89-9ebd-242b15122269 admin admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:21.820310 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15db26-d4a1-4a89-9ebd-242b15122269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:21.820581 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15db26-d4a1-4a89-9ebd-242b15122269 admin admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:21.821215 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15db26-d4a1-4a89-9ebd-242b15122269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:29:21.822211 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: WARNING py.warnings [None req-9b15db26-d4a1-4a89-9ebd-242b15122269 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:29:21.822211 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: warnings.warn(msg) Aug 11 18:29:21.822211 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: Aug 11 18:29:21.823459 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15db26-d4a1-4a89-9ebd-242b15122269 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:29:21.916809 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 569/1115] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:29:21 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:29:21.921090 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8681ddf-a447-40c4-8212-6ed2a131ac88 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:29:21.931532 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8681ddf-a447-40c4-8212-6ed2a131ac88 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:29:21.936181 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b15bb8-cdc6-4990-8dd8-febf8fcd8e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:29:21.936773 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b15bb8-cdc6-4990-8dd8-febf8fcd8e3d admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:21.937049 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b15bb8-cdc6-4990-8dd8-febf8fcd8e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:21.937319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b15bb8-cdc6-4990-8dd8-febf8fcd8e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:21.937947 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b15bb8-cdc6-4990-8dd8-febf8fcd8e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:29:21.939103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-50b15bb8-cdc6-4990-8dd8-febf8fcd8e3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:29:21.939103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Aug 11 18:29:21.939103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: Aug 11 18:29:21.940008 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b15bb8-cdc6-4990-8dd8-febf8fcd8e3d admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:29:21.952541 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 547/1116] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 11 18:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:29:21.956933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15db26-d4a1-4a89-9ebd-242b15122269 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:29:21.966765 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15db26-d4a1-4a89-9ebd-242b15122269 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:29:21.972096 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb92246-72ad-4bee-a81e-f789d9944fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:29:21.972677 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb92246-72ad-4bee-a81e-f789d9944fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:21.972954 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb92246-72ad-4bee-a81e-f789d9944fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:21.973222 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb92246-72ad-4bee-a81e-f789d9944fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:21.973848 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb92246-72ad-4bee-a81e-f789d9944fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:29:21.974874 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: WARNING py.warnings [None req-bbb92246-72ad-4bee-a81e-f789d9944fd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:29:21.974874 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: warnings.warn(msg) Aug 11 18:29:21.974874 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: Aug 11 18:29:21.975748 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb92246-72ad-4bee-a81e-f789d9944fd0 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:29:21.994917 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 570/1117] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 11 18:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:29:21.998877 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b15bb8-cdc6-4990-8dd8-febf8fcd8e3d admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:29:22.008931 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b15bb8-cdc6-4990-8dd8-febf8fcd8e3d admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:29:22.013470 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e985b-672b-496d-8cc4-dc0f7339257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:29:22.014104 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e985b-672b-496d-8cc4-dc0f7339257c admin admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:22.014384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e985b-672b-496d-8cc4-dc0f7339257c admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:22.014656 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e985b-672b-496d-8cc4-dc0f7339257c admin admin] PATH_INFO: `/v3/projects/20bab64ea1084d68bc57ccff327ed523/users/020c0f0a0bbb4326bb63503485c86f12/roles/1e94f00bf0f044b89bc9bd8dab18e2fa` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:22.029907 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e985b-672b-496d-8cc4-dc0f7339257c admin admin] RBAC: Authorizing `identity:create_grant(project_id=20bab64ea1084d68bc57ccff327ed523, user_id=020c0f0a0bbb4326bb63503485c86f12, role_id=1e94f00bf0f044b89bc9bd8dab18e2fa)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:29:22.031000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-e66e985b-672b-496d-8cc4-dc0f7339257c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:29:22.031000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Aug 11 18:29:22.031000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: Aug 11 18:29:22.032998 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e985b-672b-496d-8cc4-dc0f7339257c admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:29:22.139846 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 548/1118] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 11 18:29:21 2022] PUT /identity/v3/projects/20bab64ea1084d68bc57ccff327ed523/users/020c0f0a0bbb4326bb63503485c86f12/roles/1e94f00bf0f044b89bc9bd8dab18e2fa => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:29:22.152490 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a00fe3-8714-4608-b50b-2b137b67ebde None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:22.152775 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a00fe3-8714-4608-b50b-2b137b67ebde None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:22.153047 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a00fe3-8714-4608-b50b-2b137b67ebde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:22.180989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-c4a00fe3-8714-4608-b50b-2b137b67ebde None None] MFA Rules not processed for user `020c0f0a0bbb4326bb63503485c86f12`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:29:22.182243 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-c4a00fe3-8714-4608-b50b-2b137b67ebde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:29:22.246017 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 571/1119] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:29:22 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:29:22.259988 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7e2c9-5a0d-4f25-bed1-53cceea12123 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:22.260272 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7e2c9-5a0d-4f25-bed1-53cceea12123 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:22.260547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7e2c9-5a0d-4f25-bed1-53cceea12123 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:22.261870 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 549/1120] 10.222.0.15 () {54 vars in 964 bytes} [Thu Aug 11 18:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:29:22.266798 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c671e6-151e-4eed-9e80-51f9030caa1b None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:22.267093 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c671e6-151e-4eed-9e80-51f9030caa1b None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:22.267369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c671e6-151e-4eed-9e80-51f9030caa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:22.287035 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-11c671e6-151e-4eed-9e80-51f9030caa1b None None] MFA Rules not processed for user `8f3f1554e540472ca6e38f65a1401d59`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:29:22.288217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-11c671e6-151e-4eed-9e80-51f9030caa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:29:22.331335 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:29:22.338565 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 572/1121] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Aug 11 18:29:22 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:29:22.346381 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7e2c9-5a0d-4f25-bed1-53cceea12123 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:29:22.356707 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7e2c9-5a0d-4f25-bed1-53cceea12123 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:29:22.360171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414d6ab-ae8e-4b4d-ab85-c1685e470c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3f1554e540472ca6e38f65a1401d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:29:22.360749 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414d6ab-ae8e-4b4d-ab85-c1685e470c6e service cinder] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:22.361027 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414d6ab-ae8e-4b4d-ab85-c1685e470c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:22.361304 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414d6ab-ae8e-4b4d-ab85-c1685e470c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:22.370122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414d6ab-ae8e-4b4d-ab85-c1685e470c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:29:22.371896 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414d6ab-ae8e-4b4d-ab85-c1685e470c6e service cinder] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:29:22.381198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 550/1122] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:29:22 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:29:22.419560 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37772865-51c0-497c-abd0-93aec33f86d6 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:22.419848 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37772865-51c0-497c-abd0-93aec33f86d6 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:22.420123 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37772865-51c0-497c-abd0-93aec33f86d6 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:22.421373 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 573/1123] 10.222.0.15 () {52 vars in 830 bytes} [Thu Aug 11 18:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:29:22.424990 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414d6ab-ae8e-4b4d-ab85-c1685e470c6e service cinder] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:29:22.485232 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414d6ab-ae8e-4b4d-ab85-c1685e470c6e service cinder] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:29:22.489811 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:29:22.490425 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:22.490737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:22.491013 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] PATH_INFO: `/v3/users/020c0f0a0bbb4326bb63503485c86f12` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:22.492129 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=020c0f0a0bbb4326bb63503485c86f12)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:29:22.493133 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:29:22.493133 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Aug 11 18:29:22.493133 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: Aug 11 18:29:22.494627 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:29:22.696426 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020c0f0a0bbb4326bb63503485c86f12'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:29:22.710650 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020c0f0a0bbb4326bb63503485c86f12'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:29:22.733124 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020c0f0a0bbb4326bb63503485c86f12'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:29:22.737967 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:29:22.818634 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020c0f0a0bbb4326bb63503485c86f12'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:29:22.819408 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020c0f0a0bbb4326bb63503485c86f12'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:29:22.825832 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 551/1124] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 11 18:29:22 2022] DELETE /identity/v3/users/020c0f0a0bbb4326bb63503485c86f12 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:29:22.830381 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5caa93-84ec-42de-a4d3-b555365fc3c1 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:22.830897 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5caa93-84ec-42de-a4d3-b555365fc3c1 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:22.831091 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5caa93-84ec-42de-a4d3-b555365fc3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:22.849829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-ef5caa93-84ec-42de-a4d3-b555365fc3c1 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:29:22.851094 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-ef5caa93-84ec-42de-a4d3-b555365fc3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:29:22.910840 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 574/1125] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:29:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:29:22.920244 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:29:22.921701 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:29:22.991156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a394-5289-4bbf-9e7d-e91254919e2e admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:29:22.995032 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1b59-c713-4a32-a8b6-084dd9089a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:29:22.995626 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1b59-c713-4a32-a8b6-084dd9089a4d service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:22.995903 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1b59-c713-4a32-a8b6-084dd9089a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:22.996170 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1b59-c713-4a32-a8b6-084dd9089a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:23.005083 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee1b59-c713-4a32-a8b6-084dd9089a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:29:23.006501 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee1b59-c713-4a32-a8b6-084dd9089a4d service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:29:23.015816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 552/1126] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:29:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:29:23.530185 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5caa93-84ec-42de-a4d3-b555365fc3c1 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:29:23.531771 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-ef5caa93-84ec-42de-a4d3-b555365fc3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:29:23.543975 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5caa93-84ec-42de-a4d3-b555365fc3c1 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:29:23.549436 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:29:23.550283 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:29:23.550564 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:29:23.550860 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] PATH_INFO: `/v3/projects/20bab64ea1084d68bc57ccff327ed523` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:29:23.552146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] RBAC: Authorizing `identity:delete_project(project_id=20bab64ea1084d68bc57ccff327ed523)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:29:23.553062 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: WARNING py.warnings [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:29:23.553062 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: warnings.warn(msg) Aug 11 18:29:23.553062 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: Aug 11 18:29:23.554327 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:29:23.676586 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20bab64ea1084d68bc57ccff327ed523', 'request_id': 'req-c2aa599b-82f3-4ad7-80e1-00335ba6725b'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:29:23.689598 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20bab64ea1084d68bc57ccff327ed523', 'request_id': 'req-c2aa599b-82f3-4ad7-80e1-00335ba6725b'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:29:23.772913 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20bab64ea1084d68bc57ccff327ed523', 'request_id': 'req-c2aa599b-82f3-4ad7-80e1-00335ba6725b'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:29:23.784902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] The token cache is being invalidate because project 20bab64ea1084d68bc57ccff327ed523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 18:29:23.785191 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:29:23.785921 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-c2aa599b-82f3-4ad7-80e1-00335ba6725b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:29:23.787487 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 575/1127] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 11 18:29:23 2022] DELETE /identity/v3/projects/20bab64ea1084d68bc57ccff327ed523 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:29:33.011720 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:DELETE=1,keystone:SELECT=33 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:29:33.781240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:30:48.600677 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5855c-c4e2-40df-8d64-f3f0fc4f371d None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:30:48.601270 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5855c-c4e2-40df-8d64-f3f0fc4f371d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:30:48.601270 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5855c-c4e2-40df-8d64-f3f0fc4f371d None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:30:48.602565 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 553/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:30:48.607470 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f409d-645e-4beb-a0f5-968b98178081 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:30:48.607900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f409d-645e-4beb-a0f5-968b98178081 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:30:48.608009 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f409d-645e-4beb-a0f5-968b98178081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:30:48.627927 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-f39f409d-645e-4beb-a0f5-968b98178081 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:30:48.629112 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-f39f409d-645e-4beb-a0f5-968b98178081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:30:48.685683 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 576/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:30:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:30:48.843636 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5855c-c4e2-40df-8d64-f3f0fc4f371d None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:30:48.845319 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b2b5855c-c4e2-40df-8d64-f3f0fc4f371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:30:48.916917 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5855c-c4e2-40df-8d64-f3f0fc4f371d None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:30:48.921855 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaed69-3b40-40ff-9936-a681b694c6f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:30:48.922455 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaed69-3b40-40ff-9936-a681b694c6f3 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:30:48.923008 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaed69-3b40-40ff-9936-a681b694c6f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:30:48.923156 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaed69-3b40-40ff-9936-a681b694c6f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:30:48.931268 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaed69-3b40-40ff-9936-a681b694c6f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:30:48.932969 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaed69-3b40-40ff-9936-a681b694c6f3 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:30:48.942387 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 554/1130] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:30:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:30:49.773119 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c52134-0a4c-4d96-abdc-2e2d85c8ddd0 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:30:49.773638 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c52134-0a4c-4d96-abdc-2e2d85c8ddd0 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:30:49.773638 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c52134-0a4c-4d96-abdc-2e2d85c8ddd0 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:30:49.774991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 577/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:30:49.779676 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7ebf7-3f5a-49fa-97ff-cc517631643c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:30:49.780092 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7ebf7-3f5a-49fa-97ff-cc517631643c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:30:49.780257 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7ebf7-3f5a-49fa-97ff-cc517631643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:30:49.799224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-62f7ebf7-3f5a-49fa-97ff-cc517631643c None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:30:49.800430 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-62f7ebf7-3f5a-49fa-97ff-cc517631643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:30:49.808708 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 555/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:30:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:30:49.968852 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c52134-0a4c-4d96-abdc-2e2d85c8ddd0 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:30:49.983554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c52134-0a4c-4d96-abdc-2e2d85c8ddd0 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:30:50.001217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e21b2-b9bd-4793-8892-0e6a49df8436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:30:50.001217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e21b2-b9bd-4793-8892-0e6a49df8436 service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:30:50.001217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e21b2-b9bd-4793-8892-0e6a49df8436 service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:30:50.001217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e21b2-b9bd-4793-8892-0e6a49df8436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:30:50.001623 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e21b2-b9bd-4793-8892-0e6a49df8436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:30:50.001623 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e21b2-b9bd-4793-8892-0e6a49df8436 service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:30:50.011069 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 578/1133] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:30:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:30:53.958988 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2ac4-d947-4a11-8963-e43a4b3a325f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:30:53.959515 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2ac4-d947-4a11-8963-e43a4b3a325f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:30:53.959515 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2ac4-d947-4a11-8963-e43a4b3a325f None None] PATH_INFO: `/v3` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:30:53.960771 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 556/1134] 10.222.0.23 () {54 vars in 925 bytes} [Thu Aug 11 18:30:53 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 18:30:53.966623 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396ee2f-175d-418a-99a5-f000ede67921 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:30:53.970200 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396ee2f-175d-418a-99a5-f000ede67921 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:30:53.970200 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396ee2f-175d-418a-99a5-f000ede67921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:30:53.997715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-6396ee2f-175d-418a-99a5-f000ede67921 None None] MFA Rules not processed for user `3b58fad7b1e14a5f8c492a76a8840d44`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:30:54.005107 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-6396ee2f-175d-418a-99a5-f000ede67921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:30:54.060944 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 579/1135] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Aug 11 18:30:53 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:30:59.794500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=35 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:31:01.265292 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdf60-cce6-47d3-ac84-262a428bf6b5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:01.266032 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdf60-cce6-47d3-ac84-262a428bf6b5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:01.266032 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdf60-cce6-47d3-ac84-262a428bf6b5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:01.267247 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 557/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:31:01.272468 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7f66-9fee-454c-b7a9-dd39ea972abd None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:01.272949 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7f66-9fee-454c-b7a9-dd39ea972abd None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:01.273048 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7f66-9fee-454c-b7a9-dd39ea972abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:01.295131 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-390c7f66-9fee-454c-b7a9-dd39ea972abd None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:31:01.299614 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-390c7f66-9fee-454c-b7a9-dd39ea972abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:31:01.305286 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 580/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:31:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:31:01.468844 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bdf60-cce6-47d3-ac84-262a428bf6b5 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:31:01.482934 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bdf60-cce6-47d3-ac84-262a428bf6b5 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:31:01.487791 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d12da-527e-4399-b910-2aa1f74ad2e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:31:01.488388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d12da-527e-4399-b910-2aa1f74ad2e7 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:01.488667 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d12da-527e-4399-b910-2aa1f74ad2e7 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:01.488997 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d12da-527e-4399-b910-2aa1f74ad2e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:01.501593 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d12da-527e-4399-b910-2aa1f74ad2e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:31:01.503236 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d12da-527e-4399-b910-2aa1f74ad2e7 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:31:01.517500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 558/1138] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:31:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:31:02.424804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87586ad-8fdf-42e5-a1ef-dd41a5db024f None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:02.425370 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87586ad-8fdf-42e5-a1ef-dd41a5db024f None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:02.425370 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87586ad-8fdf-42e5-a1ef-dd41a5db024f None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:02.426811 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 581/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 18:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:31:02.431653 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22016-4f88-403a-b569-3ffe3e8efc50 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:02.432065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22016-4f88-403a-b569-3ffe3e8efc50 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:02.432207 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22016-4f88-403a-b569-3ffe3e8efc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:02.451025 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-41c22016-4f88-403a-b569-3ffe3e8efc50 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:31:02.452228 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-41c22016-4f88-403a-b569-3ffe3e8efc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:31:02.462130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 559/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 18:31:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:31:02.622626 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87586ad-8fdf-42e5-a1ef-dd41a5db024f None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:31:02.636324 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87586ad-8fdf-42e5-a1ef-dd41a5db024f None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:31:02.641320 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b43c3-ea79-4ed5-bdcb-e593cd871aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:31:02.641907 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b43c3-ea79-4ed5-bdcb-e593cd871aff service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:02.642186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b43c3-ea79-4ed5-bdcb-e593cd871aff service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:02.642464 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b43c3-ea79-4ed5-bdcb-e593cd871aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:02.651424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b43c3-ea79-4ed5-bdcb-e593cd871aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:31:02.652995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b43c3-ea79-4ed5-bdcb-e593cd871aff service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:31:02.663146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 582/1141] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:31:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:31:03.358303 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c95f3-6983-4f94-9bb6-0fb796b0f1e3 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:03.358622 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c95f3-6983-4f94-9bb6-0fb796b0f1e3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:03.358931 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c95f3-6983-4f94-9bb6-0fb796b0f1e3 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:03.360265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 560/1142] 10.222.0.15 () {54 vars in 961 bytes} [Thu Aug 11 18:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:31:03.366174 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3d24e-19ca-497f-aa5e-001d887901a1 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:03.366458 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3d24e-19ca-497f-aa5e-001d887901a1 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:03.366755 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3d24e-19ca-497f-aa5e-001d887901a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:03.386929 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-3fd3d24e-19ca-497f-aa5e-001d887901a1 None None] MFA Rules not processed for user `3b58fad7b1e14a5f8c492a76a8840d44`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:31:03.388181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-3fd3d24e-19ca-497f-aa5e-001d887901a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:31:03.396642 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 583/1143] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Aug 11 18:31:03 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:31:03.404062 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c95f3-6983-4f94-9bb6-0fb796b0f1e3 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:31:03.417055 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c95f3-6983-4f94-9bb6-0fb796b0f1e3 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:31:03.421957 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91563f-e056-42ff-9007-ebe70cbf27c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b58fad7b1e14a5f8c492a76a8840d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:31:03.422535 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91563f-e056-42ff-9007-ebe70cbf27c0 service placement] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:03.422868 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91563f-e056-42ff-9007-ebe70cbf27c0 service placement] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:03.423139 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91563f-e056-42ff-9007-ebe70cbf27c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:03.432000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91563f-e056-42ff-9007-ebe70cbf27c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:31:03.433501 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91563f-e056-42ff-9007-ebe70cbf27c0 service placement] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:31:03.444029 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 561/1144] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:31:03 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:31:06.806331 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c1e36-6b04-4c74-9969-a6ca65237833 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:06.806930 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c1e36-6b04-4c74-9969-a6ca65237833 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:06.806930 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c1e36-6b04-4c74-9969-a6ca65237833 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:06.808239 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 584/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:31:06.813399 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b594b3e-d08c-49c2-84bc-122882d5c8e6 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:06.813856 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b594b3e-d08c-49c2-84bc-122882d5c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:06.813965 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b594b3e-d08c-49c2-84bc-122882d5c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:06.836166 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-8b594b3e-d08c-49c2-84bc-122882d5c8e6 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:31:06.837389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-8b594b3e-d08c-49c2-84bc-122882d5c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:31:06.845397 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 562/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:31:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:31:07.200975 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c1e36-6b04-4c74-9969-a6ca65237833 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:31:07.202701 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-211c1e36-6b04-4c74-9969-a6ca65237833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:31:07.255173 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=100 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:31:07.260578 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c1e36-6b04-4c74-9969-a6ca65237833 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:31:07.264031 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864322ce-10d4-4653-b6c6-1aac95220118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:31:07.264624 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864322ce-10d4-4653-b6c6-1aac95220118 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:07.264906 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864322ce-10d4-4653-b6c6-1aac95220118 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:07.265176 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864322ce-10d4-4653-b6c6-1aac95220118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:07.274160 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864322ce-10d4-4653-b6c6-1aac95220118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:31:07.275625 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864322ce-10d4-4653-b6c6-1aac95220118 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:31:07.285033 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 585/1147] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:31:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:31:09.453539 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678b641-ce92-4d82-bc9c-4f5ea1aa514d None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:09.454046 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678b641-ce92-4d82-bc9c-4f5ea1aa514d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:09.454046 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678b641-ce92-4d82-bc9c-4f5ea1aa514d None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:09.455388 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 563/1148] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:31:09.461399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3fff4-8da2-453f-a2ea-7338b889a090 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:09.461831 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3fff4-8da2-453f-a2ea-7338b889a090 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:09.461953 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3fff4-8da2-453f-a2ea-7338b889a090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:09.482035 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-7ff3fff4-8da2-453f-a2ea-7338b889a090 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:31:09.483274 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-7ff3fff4-8da2-453f-a2ea-7338b889a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:31:09.491064 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 586/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:31:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:31:09.839157 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678b641-ce92-4d82-bc9c-4f5ea1aa514d None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:31:09.849826 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678b641-ce92-4d82-bc9c-4f5ea1aa514d None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:31:09.853276 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb36599-9ff7-43e0-aba9-09d1ea416cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:31:09.853861 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb36599-9ff7-43e0-aba9-09d1ea416cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:09.854141 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb36599-9ff7-43e0-aba9-09d1ea416cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:09.854413 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb36599-9ff7-43e0-aba9-09d1ea416cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:09.863109 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb36599-9ff7-43e0-aba9-09d1ea416cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:31:09.865120 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb36599-9ff7-43e0-aba9-09d1ea416cc9 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:31:09.874580 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 564/1150] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:31:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:31:13.603742 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff525f9-95a9-46e7-b1c9-ae4b5bf0eeb5 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:13.604331 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff525f9-95a9-46e7-b1c9-ae4b5bf0eeb5 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:13.604331 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff525f9-95a9-46e7-b1c9-ae4b5bf0eeb5 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:13.605626 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 587/1151] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:31:13.610859 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662ac0e-178c-4154-904d-657bde2613f7 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:13.611247 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662ac0e-178c-4154-904d-657bde2613f7 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:13.611413 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662ac0e-178c-4154-904d-657bde2613f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:13.760790 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-e662ac0e-178c-4154-904d-657bde2613f7 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:31:13.762015 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-e662ac0e-178c-4154-904d-657bde2613f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:31:13.769818 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 565/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:31:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:31:14.353971 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff525f9-95a9-46e7-b1c9-ae4b5bf0eeb5 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:31:14.355634 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-1ff525f9-95a9-46e7-b1c9-ae4b5bf0eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:31:14.412787 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff525f9-95a9-46e7-b1c9-ae4b5bf0eeb5 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:31:14.416328 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e8e74-5920-4d34-87ca-5bf08d22fa3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3f1554e540472ca6e38f65a1401d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:31:14.416920 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e8e74-5920-4d34-87ca-5bf08d22fa3c service cinder] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:14.417205 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e8e74-5920-4d34-87ca-5bf08d22fa3c service cinder] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:14.417525 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e8e74-5920-4d34-87ca-5bf08d22fa3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:14.426930 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e8e74-5920-4d34-87ca-5bf08d22fa3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:31:14.428451 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e8e74-5920-4d34-87ca-5bf08d22fa3c service cinder] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:31:14.437648 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 588/1153] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:31:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:31:16.644314 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2c467-6219-40ed-b367-9b11242501e9 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:16.644915 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2c467-6219-40ed-b367-9b11242501e9 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:16.644915 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2c467-6219-40ed-b367-9b11242501e9 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:16.646496 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 566/1154] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 18:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:31:16.651656 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8452f-ef45-4d43-8381-fdf7eb3b7b8b None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:16.652081 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8452f-ef45-4d43-8381-fdf7eb3b7b8b None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:16.652240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8452f-ef45-4d43-8381-fdf7eb3b7b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:16.671735 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-9fd8452f-ef45-4d43-8381-fdf7eb3b7b8b None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:31:16.672940 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-9fd8452f-ef45-4d43-8381-fdf7eb3b7b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:31:16.681220 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 589/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 18:31:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:31:17.255861 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2c467-6219-40ed-b367-9b11242501e9 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:31:17.257541 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-46c2c467-6219-40ed-b367-9b11242501e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:31:17.270684 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2c467-6219-40ed-b367-9b11242501e9 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:31:17.274389 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d49ac-557a-47fd-a272-7e382a06ed5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f3f1554e540472ca6e38f65a1401d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:31:17.275034 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d49ac-557a-47fd-a272-7e382a06ed5a service cinder] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:31:17.275312 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d49ac-557a-47fd-a272-7e382a06ed5a service cinder] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:31:17.275585 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d49ac-557a-47fd-a272-7e382a06ed5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:31:17.284352 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d49ac-557a-47fd-a272-7e382a06ed5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:31:17.285746 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d49ac-557a-47fd-a272-7e382a06ed5a service cinder] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:31:17.295759 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 567/1156] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:31:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:31:26.666300 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=37 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:31:27.291547 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=33 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:32:32.097732 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8022e-3da8-4e6f-be28-3a0ad6b90c95 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.098341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8022e-3da8-4e6f-be28-3a0ad6b90c95 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.098341 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8022e-3da8-4e6f-be28-3a0ad6b90c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.102383 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecf76e-ea7e-4ed6-ae6d-cc493a541cb0 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.102896 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecf76e-ea7e-4ed6-ae6d-cc493a541cb0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.103000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecf76e-ea7e-4ed6-ae6d-cc493a541cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.120285 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-ecb8022e-3da8-4e6f-be28-3a0ad6b90c95 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:32.124240 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-ecb8022e-3da8-4e6f-be28-3a0ad6b90c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:32.124351 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c9ecf76e-ea7e-4ed6-ae6d-cc493a541cb0 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:32.124748 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c9ecf76e-ea7e-4ed6-ae6d-cc493a541cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:32.129489 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 590/1157] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:32:32.133077 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 568/1158] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:32:32.137881 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c6f0-56d4-49f7-b841-93940e2cfd59 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.138167 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c6f0-56d4-49f7-b841-93940e2cfd59 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.138440 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c6f0-56d4-49f7-b841-93940e2cfd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.141037 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d153c4-f0ed-4c50-8e87-5af392ba4904 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.141325 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d153c4-f0ed-4c50-8e87-5af392ba4904 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.141630 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d153c4-f0ed-4c50-8e87-5af392ba4904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.158207 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-2156c6f0-56d4-49f7-b841-93940e2cfd59 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:32.159467 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-2156c6f0-56d4-49f7-b841-93940e2cfd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:32.160635 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-63d153c4-f0ed-4c50-8e87-5af392ba4904 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:32.161805 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-63d153c4-f0ed-4c50-8e87-5af392ba4904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:32.168289 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 591/1159] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:32:32.170812 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 569/1160] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:32:32.175929 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156c6f0-56d4-49f7-b841-93940e2cfd59 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.179555 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d153c4-f0ed-4c50-8e87-5af392ba4904 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.182771 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156c6f0-56d4-49f7-b841-93940e2cfd59 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.187419 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30af71-8fea-4442-9d8b-b7396c504f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.188004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30af71-8fea-4442-9d8b-b7396c504f80 admin admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.188285 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30af71-8fea-4442-9d8b-b7396c504f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.188511 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d153c4-f0ed-4c50-8e87-5af392ba4904 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.188630 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30af71-8fea-4442-9d8b-b7396c504f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.189214 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30af71-8fea-4442-9d8b-b7396c504f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88295) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:32:32.189516 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30af71-8fea-4442-9d8b-b7396c504f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.191137 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30af71-8fea-4442-9d8b-b7396c504f80 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.193050 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f54140-feaf-40a0-89d0-8b1359b77055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.193763 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f54140-feaf-40a0-89d0-8b1359b77055 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.194038 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f54140-feaf-40a0-89d0-8b1359b77055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.194483 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f54140-feaf-40a0-89d0-8b1359b77055 admin admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.195142 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f54140-feaf-40a0-89d0-8b1359b77055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 18:32:32.195441 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f54140-feaf-40a0-89d0-8b1359b77055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.196430 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-f0f54140-feaf-40a0-89d0-8b1359b77055 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:32:32.196430 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Aug 11 18:32:32.196430 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: Aug 11 18:32:32.197293 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f54140-feaf-40a0-89d0-8b1359b77055 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.203373 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 592/1161] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 11 18:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:32:32.208681 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 570/1162] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Aug 11 18:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 18:32:32.213483 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30af71-8fea-4442-9d8b-b7396c504f80 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.217078 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f54140-feaf-40a0-89d0-8b1359b77055 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.223429 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30af71-8fea-4442-9d8b-b7396c504f80 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.227721 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f54140-feaf-40a0-89d0-8b1359b77055 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.228517 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae7ce9-b20c-42fe-9cba-3ac01c4a9f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.229103 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae7ce9-b20c-42fe-9cba-3ac01c4a9f21 admin admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.229384 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae7ce9-b20c-42fe-9cba-3ac01c4a9f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.229652 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae7ce9-b20c-42fe-9cba-3ac01c4a9f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.230298 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae7ce9-b20c-42fe-9cba-3ac01c4a9f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.231333 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: WARNING py.warnings [None req-feae7ce9-b20c-42fe-9cba-3ac01c4a9f21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:32:32.231333 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: warnings.warn(msg) Aug 11 18:32:32.231333 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: Aug 11 18:32:32.232369 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e2c3-97e3-41ed-9212-fb999a4df3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.232481 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae7ce9-b20c-42fe-9cba-3ac01c4a9f21 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.232954 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e2c3-97e3-41ed-9212-fb999a4df3af admin admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.233233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e2c3-97e3-41ed-9212-fb999a4df3af admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.233504 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e2c3-97e3-41ed-9212-fb999a4df3af admin admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.234115 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70e2c3-97e3-41ed-9212-fb999a4df3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.236021 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70e2c3-97e3-41ed-9212-fb999a4df3af admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.345991 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 593/1163] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 11 18:32:32 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:32:32.350859 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae7ce9-b20c-42fe-9cba-3ac01c4a9f21 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.376268 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 571/1164] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 11 18:32:32 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:32:32.382065 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e2c3-97e3-41ed-9212-fb999a4df3af admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.414639 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae7ce9-b20c-42fe-9cba-3ac01c4a9f21 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.444330 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e2c3-97e3-41ed-9212-fb999a4df3af admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.448995 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d799a0-099c-4709-88a6-5311e79aff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.449584 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d799a0-099c-4709-88a6-5311e79aff28 admin admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.449859 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d799a0-099c-4709-88a6-5311e79aff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.450127 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d799a0-099c-4709-88a6-5311e79aff28 admin admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.450778 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d799a0-099c-4709-88a6-5311e79aff28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.451888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-57d799a0-099c-4709-88a6-5311e79aff28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:32:32.451888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Aug 11 18:32:32.451888 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: Aug 11 18:32:32.453082 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d799a0-099c-4709-88a6-5311e79aff28 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.469966 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9cf5-1fbe-4669-a396-24e01ca45773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.470626 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9cf5-1fbe-4669-a396-24e01ca45773 admin admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.483230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9cf5-1fbe-4669-a396-24e01ca45773 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.483230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9cf5-1fbe-4669-a396-24e01ca45773 admin admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.483230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d9cf5-1fbe-4669-a396-24e01ca45773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.483230 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d9cf5-1fbe-4669-a396-24e01ca45773 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.561782 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 572/1165] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:32:32 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:32:32.565882 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d799a0-099c-4709-88a6-5311e79aff28 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.575777 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d799a0-099c-4709-88a6-5311e79aff28 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.579997 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 594/1166] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:32:32 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:32:32.581079 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9cf5-1fbe-4669-a396-24e01ca45773 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.583473 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e395b53-4df5-4fd7-8406-23b18680fc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.584581 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e395b53-4df5-4fd7-8406-23b18680fc69 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.584854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e395b53-4df5-4fd7-8406-23b18680fc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.585122 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e395b53-4df5-4fd7-8406-23b18680fc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.585786 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e395b53-4df5-4fd7-8406-23b18680fc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.587448 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e395b53-4df5-4fd7-8406-23b18680fc69 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.591456 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9cf5-1fbe-4669-a396-24e01ca45773 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.596467 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde3be-4ba0-4977-a6a6-198f62198367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.597054 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde3be-4ba0-4977-a6a6-198f62198367 admin admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.597332 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde3be-4ba0-4977-a6a6-198f62198367 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.597607 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde3be-4ba0-4977-a6a6-198f62198367 admin admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.598000 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 573/1167] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 11 18:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 18:32:32.598243 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fde3be-4ba0-4977-a6a6-198f62198367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.600568 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fde3be-4ba0-4977-a6a6-198f62198367 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.602712 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e395b53-4df5-4fd7-8406-23b18680fc69 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.610943 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 595/1168] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 11 18:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:32:32.612315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e395b53-4df5-4fd7-8406-23b18680fc69 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.614632 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde3be-4ba0-4977-a6a6-198f62198367 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.617131 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ff3c-fb7a-42d8-8b2c-2efdf114770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.617748 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ff3c-fb7a-42d8-8b2c-2efdf114770f admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.617996 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ff3c-fb7a-42d8-8b2c-2efdf114770f admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.618267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ff3c-fb7a-42d8-8b2c-2efdf114770f admin admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.618957 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11ff3c-fb7a-42d8-8b2c-2efdf114770f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.622436 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11ff3c-fb7a-42d8-8b2c-2efdf114770f admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.624418 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fde3be-4ba0-4977-a6a6-198f62198367 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.629333 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0c889-acc7-4872-b6a8-bb7b5033484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.629909 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c889-acc7-4872-b6a8-bb7b5033484d admin admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.630188 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c889-acc7-4872-b6a8-bb7b5033484d admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.630461 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c889-acc7-4872-b6a8-bb7b5033484d admin admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.631508 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 574/1169] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 11 18:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 18:32:32.631788 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0c889-acc7-4872-b6a8-bb7b5033484d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.633459 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0c889-acc7-4872-b6a8-bb7b5033484d admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.635726 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ff3c-fb7a-42d8-8b2c-2efdf114770f admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.647760 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 596/1170] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 11 18:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 18:32:32.647917 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ff3c-fb7a-42d8-8b2c-2efdf114770f admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.648738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0c889-acc7-4872-b6a8-bb7b5033484d admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.650879 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a6600-9359-4d7a-adf9-53b8a58bc6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.651525 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a6600-9359-4d7a-adf9-53b8a58bc6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.651800 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a6600-9359-4d7a-adf9-53b8a58bc6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.652071 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a6600-9359-4d7a-adf9-53b8a58bc6a9 admin admin] PATH_INFO: `/v3/projects/360e08d4de334b9fa7e027999f9109e9/users/69c8be94fe834f34b8ce9ae8cb309472/roles/1e94f00bf0f044b89bc9bd8dab18e2fa` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.658275 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0c889-acc7-4872-b6a8-bb7b5033484d admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.663022 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eafec-a61f-410e-8ba2-51dbacf88680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.663653 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eafec-a61f-410e-8ba2-51dbacf88680 admin admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.663935 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eafec-a61f-410e-8ba2-51dbacf88680 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.664203 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eafec-a61f-410e-8ba2-51dbacf88680 admin admin] PATH_INFO: `/v3/projects/4d8281dcaf46470b92ce90c4d62108f8/users/84b5b864adc046aaa582a5cb74f73483/roles/1e94f00bf0f044b89bc9bd8dab18e2fa` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.666734 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a6600-9359-4d7a-adf9-53b8a58bc6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=360e08d4de334b9fa7e027999f9109e9, user_id=69c8be94fe834f34b8ce9ae8cb309472, role_id=1e94f00bf0f044b89bc9bd8dab18e2fa)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.669372 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a6600-9359-4d7a-adf9-53b8a58bc6a9 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.678141 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eafec-a61f-410e-8ba2-51dbacf88680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8281dcaf46470b92ce90c4d62108f8, user_id=84b5b864adc046aaa582a5cb74f73483, role_id=1e94f00bf0f044b89bc9bd8dab18e2fa)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.679217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: WARNING py.warnings [None req-9a7eafec-a61f-410e-8ba2-51dbacf88680 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 18:32:32.679217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: warnings.warn(msg) Aug 11 18:32:32.679217 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: Aug 11 18:32:32.681118 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eafec-a61f-410e-8ba2-51dbacf88680 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.762405 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 575/1171] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 11 18:32:32 2022] PUT /identity/v3/projects/360e08d4de334b9fa7e027999f9109e9/users/69c8be94fe834f34b8ce9ae8cb309472/roles/1e94f00bf0f044b89bc9bd8dab18e2fa => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 18:32:32.767617 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd0b8a-de5a-49f9-ad74-af9090829c03 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.767905 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd0b8a-de5a-49f9-ad74-af9090829c03 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.768180 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd0b8a-de5a-49f9-ad74-af9090829c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.770827 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 597/1172] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 11 18:32:32 2022] PUT /identity/v3/projects/4d8281dcaf46470b92ce90c4d62108f8/users/84b5b864adc046aaa582a5cb74f73483/roles/1e94f00bf0f044b89bc9bd8dab18e2fa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:32:32.780985 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bd2b8-7b12-4591-b39b-1f30aa4c4525 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.781275 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bd2b8-7b12-4591-b39b-1f30aa4c4525 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.781549 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bd2b8-7b12-4591-b39b-1f30aa4c4525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.787540 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b4dd0b8a-de5a-49f9-ad74-af9090829c03 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:32.788788 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b4dd0b8a-de5a-49f9-ad74-af9090829c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:32.788918 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:32:32.800399 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-674bd2b8-7b12-4591-b39b-1f30aa4c4525 None None] MFA Rules not processed for user `88fec54a2c514363b52e38552e10c343`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:32.804233 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-674bd2b8-7b12-4591-b39b-1f30aa4c4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:32.837749 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:32:32.849269 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 576/1173] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:32:32.860270 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd0b8a-de5a-49f9-ad74-af9090829c03 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.861577 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b4dd0b8a-de5a-49f9-ad74-af9090829c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:32.861758 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 598/1174] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:32:32.874216 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bd2b8-7b12-4591-b39b-1f30aa4c4525 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:32.920442 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd0b8a-de5a-49f9-ad74-af9090829c03 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.924637 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afbcf1-93c9-474c-bd11-23c4829f6b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.925364 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afbcf1-93c9-474c-bd11-23c4829f6b0c service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.925683 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afbcf1-93c9-474c-bd11-23c4829f6b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.926012 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afbcf1-93c9-474c-bd11-23c4829f6b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.930067 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bd2b8-7b12-4591-b39b-1f30aa4c4525 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:32.934489 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd21dd2-2d2d-4193-b5ca-5738278ab705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:32.935140 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd21dd2-2d2d-4193-b5ca-5738278ab705 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:32.935424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd21dd2-2d2d-4193-b5ca-5738278ab705 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:32.935700 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd21dd2-2d2d-4193-b5ca-5738278ab705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:32.936394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afbcf1-93c9-474c-bd11-23c4829f6b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.938199 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afbcf1-93c9-474c-bd11-23c4829f6b0c service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.945365 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd21dd2-2d2d-4193-b5ca-5738278ab705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:32.946804 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd21dd2-2d2d-4193-b5ca-5738278ab705 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:32.948399 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 577/1175] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:32:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 18:32:32.956407 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 599/1176] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:32:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 18:32:39.275246 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79bfd-4de2-4899-bca6-600ad50c07bc None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:39.275764 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79bfd-4de2-4899-bca6-600ad50c07bc None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:39.275999 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79bfd-4de2-4899-bca6-600ad50c07bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:39.323312 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-4cf79bfd-4de2-4899-bca6-600ad50c07bc None None] MFA Rules not processed for user `84b5b864adc046aaa582a5cb74f73483`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:39.324727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-4cf79bfd-4de2-4899-bca6-600ad50c07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:39.421546 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 578/1177] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:39 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:32:39.428169 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd21dd2-2d2d-4193-b5ca-5738278ab705 service neutron] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:39.440950 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd21dd2-2d2d-4193-b5ca-5738278ab705 service neutron] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:39.446989 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70262a45-b256-4d7c-84ec-25bd6109f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:39.448902 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262a45-b256-4d7c-84ec-25bd6109f044 admin admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:39.449338 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262a45-b256-4d7c-84ec-25bd6109f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:39.449630 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262a45-b256-4d7c-84ec-25bd6109f044 admin admin] PATH_INFO: `/v3/projects` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:39.450284 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70262a45-b256-4d7c-84ec-25bd6109f044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:39.452511 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70262a45-b256-4d7c-84ec-25bd6109f044 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:39.559545 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 600/1178] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 11 18:32:39 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 18:32:39.560675 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf79bfd-4de2-4899-bca6-600ad50c07bc None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:39.581774 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf79bfd-4de2-4899-bca6-600ad50c07bc None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:39.719985 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4cf8f-aeea-4f34-b60e-33c8a4183ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:39.720599 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4cf8f-aeea-4f34-b60e-33c8a4183ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:39.720989 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4cf8f-aeea-4f34-b60e-33c8a4183ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:39.721515 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4cf8f-aeea-4f34-b60e-33c8a4183ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:39.722466 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4cf8f-aeea-4f34-b60e-33c8a4183ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:39.724892 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4cf8f-aeea-4f34-b60e-33c8a4183ee6 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:39.859680 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 579/1179] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:32:39 2022] POST /identity/v3/users => generated 295 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:32:39.861239 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70262a45-b256-4d7c-84ec-25bd6109f044 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:39.874416 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70262a45-b256-4d7c-84ec-25bd6109f044 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:39.879593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cb62e-ba81-41b0-9e64-a461d2ff5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:39.880238 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cb62e-ba81-41b0-9e64-a461d2ff5ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:39.882832 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cb62e-ba81-41b0-9e64-a461d2ff5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:39.882832 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cb62e-ba81-41b0-9e64-a461d2ff5ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:39.882832 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cb62e-ba81-41b0-9e64-a461d2ff5ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:39.883301 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cb62e-ba81-41b0-9e64-a461d2ff5ed5 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:39.892210 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0f8e2-637e-4b52-94e3-104545a230b2 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:39.892492 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0f8e2-637e-4b52-94e3-104545a230b2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:39.892768 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0f8e2-637e-4b52-94e3-104545a230b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:39.903930 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 601/1180] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 11 18:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:32:39.905076 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cb62e-ba81-41b0-9e64-a461d2ff5ed5 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:39.916336 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cb62e-ba81-41b0-9e64-a461d2ff5ed5 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:39.922906 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7c060-79e6-43c9-a795-4d7f4d00c918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:39.924080 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7c060-79e6-43c9-a795-4d7f4d00c918 admin admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:39.924675 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7c060-79e6-43c9-a795-4d7f4d00c918 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:39.925485 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7c060-79e6-43c9-a795-4d7f4d00c918 admin admin] PATH_INFO: `/v3/projects/74dd83498adc47af87855a25f6d2fef1/users/86be54de751f4df589155aa1caeb2889/roles/f89efd1f713043d8835c127de30f53ca` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:39.927030 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-aed0f8e2-637e-4b52-94e3-104545a230b2 None None] MFA Rules not processed for user `69c8be94fe834f34b8ce9ae8cb309472`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:39.928745 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-aed0f8e2-637e-4b52-94e3-104545a230b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:39.934311 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:32:39.949622 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7c060-79e6-43c9-a795-4d7f4d00c918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74dd83498adc47af87855a25f6d2fef1, user_id=86be54de751f4df589155aa1caeb2889, role_id=f89efd1f713043d8835c127de30f53ca)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:39.953894 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7c060-79e6-43c9-a795-4d7f4d00c918 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:40.023169 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 580/1181] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:39 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:32:40.027526 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0f8e2-637e-4b52-94e3-104545a230b2 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:40.038027 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 602/1182] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 11 18:32:39 2022] PUT /identity/v3/projects/74dd83498adc47af87855a25f6d2fef1/users/86be54de751f4df589155aa1caeb2889/roles/f89efd1f713043d8835c127de30f53ca => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:32:40.039974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0f8e2-637e-4b52-94e3-104545a230b2 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:40.042290 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7c060-79e6-43c9-a795-4d7f4d00c918 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:40.099008 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:32:40.101803 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe4d0-6b70-4e01-b16f-864f91e88547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:40.102796 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe4d0-6b70-4e01-b16f-864f91e88547 admin admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:40.103233 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe4d0-6b70-4e01-b16f-864f91e88547 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:40.103570 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe4d0-6b70-4e01-b16f-864f91e88547 admin admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:40.104267 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fe4d0-6b70-4e01-b16f-864f91e88547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:40.106353 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fe4d0-6b70-4e01-b16f-864f91e88547 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:40.122198 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7c060-79e6-43c9-a795-4d7f4d00c918 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:40.128028 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa1a9-47a3-4f7f-b5f8-b36e14e39daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:40.128771 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa1a9-47a3-4f7f-b5f8-b36e14e39daa admin admin] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:40.129058 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa1a9-47a3-4f7f-b5f8-b36e14e39daa admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:40.129369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa1a9-47a3-4f7f-b5f8-b36e14e39daa admin admin] PATH_INFO: `/v3/roles` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:40.130204 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caa1a9-47a3-4f7f-b5f8-b36e14e39daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:40.133107 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caa1a9-47a3-4f7f-b5f8-b36e14e39daa admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:40.147625 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 603/1183] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 11 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 18:32:40.149121 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa1a9-47a3-4f7f-b5f8-b36e14e39daa admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:40.170897 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa1a9-47a3-4f7f-b5f8-b36e14e39daa admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:40.185385 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d34e25-5329-422e-ad62-964a8c0490dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:40.186104 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d34e25-5329-422e-ad62-964a8c0490dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:40.186390 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d34e25-5329-422e-ad62-964a8c0490dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:40.187048 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d34e25-5329-422e-ad62-964a8c0490dc admin admin] PATH_INFO: `/v3/projects/74dd83498adc47af87855a25f6d2fef1/users/86be54de751f4df589155aa1caeb2889/roles/f89efd1f713043d8835c127de30f53ca` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:40.189451 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d34e25-5329-422e-ad62-964a8c0490dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74dd83498adc47af87855a25f6d2fef1, user_id=86be54de751f4df589155aa1caeb2889, role_id=f89efd1f713043d8835c127de30f53ca)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:40.192755 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d34e25-5329-422e-ad62-964a8c0490dc admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:40.206209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 604/1184] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 11 18:32:40 2022] PUT /identity/v3/projects/74dd83498adc47af87855a25f6d2fef1/users/86be54de751f4df589155aa1caeb2889/roles/f89efd1f713043d8835c127de30f53ca => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 18:32:40.234185 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 581/1185] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Aug 11 18:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:32:40.240546 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d34e25-5329-422e-ad62-964a8c0490dc admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:40.326504 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d34e25-5329-422e-ad62-964a8c0490dc admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:40.408490 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177d6b-6f8c-450f-afc6-6e736a33fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:40.409086 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177d6b-6f8c-450f-afc6-6e736a33fec5 admin admin] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:40.409369 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177d6b-6f8c-450f-afc6-6e736a33fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:40.409694 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177d6b-6f8c-450f-afc6-6e736a33fec5 admin admin] PATH_INFO: `/v3/users` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:40.410322 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80177d6b-6f8c-450f-afc6-6e736a33fec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:40.415505 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80177d6b-6f8c-450f-afc6-6e736a33fec5 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:40.487998 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 605/1186] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Aug 11 18:32:40 2022] POST /identity/v3/users => generated 299 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 18:32:40.493392 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe4d0-6b70-4e01-b16f-864f91e88547 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:40.503997 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe4d0-6b70-4e01-b16f-864f91e88547 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:40.509584 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d5ad9-b01f-4d60-8973-5d40e898995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:40.510324 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d5ad9-b01f-4d60-8973-5d40e898995e admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:40.510797 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d5ad9-b01f-4d60-8973-5d40e898995e admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:40.511262 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d5ad9-b01f-4d60-8973-5d40e898995e admin admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:40.512918 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d5ad9-b01f-4d60-8973-5d40e898995e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:40.514651 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d5ad9-b01f-4d60-8973-5d40e898995e admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:40.527963 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 582/1187] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 11 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:32:40.531871 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177d6b-6f8c-450f-afc6-6e736a33fec5 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:40.545368 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177d6b-6f8c-450f-afc6-6e736a33fec5 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:40.550927 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66e329-84a8-4ca0-a0aa-ba29019cce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:40.551770 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66e329-84a8-4ca0-a0aa-ba29019cce19 admin admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:40.552379 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66e329-84a8-4ca0-a0aa-ba29019cce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:40.552379 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66e329-84a8-4ca0-a0aa-ba29019cce19 admin admin] PATH_INFO: `/v3/projects/8e2a975bf30341a794575fa53f3e6099/users/aa89b73000ea40a5ae8b44299cdd9c2d/roles/f89efd1f713043d8835c127de30f53ca` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:40.571413 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66e329-84a8-4ca0-a0aa-ba29019cce19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2a975bf30341a794575fa53f3e6099, user_id=aa89b73000ea40a5ae8b44299cdd9c2d, role_id=f89efd1f713043d8835c127de30f53ca)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:40.574377 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66e329-84a8-4ca0-a0aa-ba29019cce19 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:40.672172 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 606/1188] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 11 18:32:40 2022] PUT /identity/v3/projects/8e2a975bf30341a794575fa53f3e6099/users/aa89b73000ea40a5ae8b44299cdd9c2d/roles/f89efd1f713043d8835c127de30f53ca => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:32:40.675895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d5ad9-b01f-4d60-8973-5d40e898995e admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:40.687643 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d5ad9-b01f-4d60-8973-5d40e898995e admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:40.796315 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098e72e-696c-4202-b46a-2510e0710238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:40.796933 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e72e-696c-4202-b46a-2510e0710238 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:40.797204 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e72e-696c-4202-b46a-2510e0710238 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:40.797569 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e72e-696c-4202-b46a-2510e0710238 admin admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:40.798118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098e72e-696c-4202-b46a-2510e0710238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:40.800006 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098e72e-696c-4202-b46a-2510e0710238 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:40.819661 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 583/1189] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Aug 11 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 18:32:40.823602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66e329-84a8-4ca0-a0aa-ba29019cce19 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:40.836943 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66e329-84a8-4ca0-a0aa-ba29019cce19 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:40.843350 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e17ac-9df0-4687-839a-5b0d3d129a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:40.844235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e17ac-9df0-4687-839a-5b0d3d129a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:40.844524 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e17ac-9df0-4687-839a-5b0d3d129a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:40.844892 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e17ac-9df0-4687-839a-5b0d3d129a4b admin admin] PATH_INFO: `/v3/projects/8e2a975bf30341a794575fa53f3e6099/users/aa89b73000ea40a5ae8b44299cdd9c2d/roles/f89efd1f713043d8835c127de30f53ca` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:40.847590 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e17ac-9df0-4687-839a-5b0d3d129a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2a975bf30341a794575fa53f3e6099, user_id=aa89b73000ea40a5ae8b44299cdd9c2d, role_id=f89efd1f713043d8835c127de30f53ca)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:40.851582 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e17ac-9df0-4687-839a-5b0d3d129a4b admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:40.866738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 607/1190] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Aug 11 18:32:40 2022] PUT /identity/v3/projects/8e2a975bf30341a794575fa53f3e6099/users/aa89b73000ea40a5ae8b44299cdd9c2d/roles/f89efd1f713043d8835c127de30f53ca => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:32:47.159668 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bb998-7754-4a29-a279-7232d5e6e355 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:47.160209 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bb998-7754-4a29-a279-7232d5e6e355 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:47.160209 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bb998-7754-4a29-a279-7232d5e6e355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:47.217029 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-e21bb998-7754-4a29-a279-7232d5e6e355 None None] MFA Rules not processed for user `86be54de751f4df589155aa1caeb2889`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:47.218505 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-e21bb998-7754-4a29-a279-7232d5e6e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:47.229385 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:32:47.345981 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 584/1191] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:47 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:32:47.361222 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e17ac-9df0-4687-839a-5b0d3d129a4b admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:47.364544 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-b92e17ac-9df0-4687-839a-5b0d3d129a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:47.425925 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:32:47.472691 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e17ac-9df0-4687-839a-5b0d3d129a4b admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:47.484938 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e01b42-fbe5-4705-85e3-149829d30fb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c47252a3e4bc4b592475797aa202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:47.485923 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e01b42-fbe5-4705-85e3-149829d30fb1 service glance] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:47.486315 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e01b42-fbe5-4705-85e3-149829d30fb1 service glance] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:47.486738 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e01b42-fbe5-4705-85e3-149829d30fb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:47.555964 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e01b42-fbe5-4705-85e3-149829d30fb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:47.557931 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e01b42-fbe5-4705-85e3-149829d30fb1 service glance] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:47.576873 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 608/1192] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:32:47 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:32:48.311133 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa39fe-104a-4260-8d18-2557919ba041 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:48.311895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa39fe-104a-4260-8d18-2557919ba041 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:48.312183 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa39fe-104a-4260-8d18-2557919ba041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:48.343918 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-a8aa39fe-104a-4260-8d18-2557919ba041 None None] MFA Rules not processed for user `aa89b73000ea40a5ae8b44299cdd9c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:48.345400 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-a8aa39fe-104a-4260-8d18-2557919ba041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:48.424225 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 585/1193] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:48 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:32:48.436617 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e01b42-fbe5-4705-85e3-149829d30fb1 service glance] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:48.445822 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e01b42-fbe5-4705-85e3-149829d30fb1 service glance] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:48.449910 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9932b-5701-4eac-b788-005553a6330d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c47252a3e4bc4b592475797aa202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:48.450679 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9932b-5701-4eac-b788-005553a6330d service glance] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:48.451037 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9932b-5701-4eac-b788-005553a6330d service glance] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:48.451411 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9932b-5701-4eac-b788-005553a6330d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:48.512628 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9932b-5701-4eac-b788-005553a6330d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:48.514203 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9932b-5701-4eac-b788-005553a6330d service glance] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:48.524905 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 609/1194] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:32:48 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:32:58.033403 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8059e2-0487-464b-99d6-c404184cae73 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:58.033997 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8059e2-0487-464b-99d6-c404184cae73 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:58.033997 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8059e2-0487-464b-99d6-c404184cae73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:58.055128 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6a8059e2-0487-464b-99d6-c404184cae73 None None] MFA Rules not processed for user `69c8be94fe834f34b8ce9ae8cb309472`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:58.056559 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6a8059e2-0487-464b-99d6-c404184cae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:58.067041 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 586/1195] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:32:58 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:32:58.365421 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce2466-880e-4f9e-9624-e8ac778758da None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:58.366019 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce2466-880e-4f9e-9624-e8ac778758da None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:58.366019 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce2466-880e-4f9e-9624-e8ac778758da None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:58.367728 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 610/1196] 10.222.0.15 () {54 vars in 962 bytes} [Thu Aug 11 18:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:32:58.377625 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54a69-1da8-4734-b87e-f5bbaca760dc None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:58.378269 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54a69-1da8-4734-b87e-f5bbaca760dc None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:58.378605 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54a69-1da8-4734-b87e-f5bbaca760dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:58.401944 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-5cc54a69-1da8-4734-b87e-f5bbaca760dc None None] MFA Rules not processed for user `685c28640ca84d2b8e85d47e64430cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:58.403178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-5cc54a69-1da8-4734-b87e-f5bbaca760dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:58.487014 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 587/1197] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Aug 11 18:32:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:32:58.493042 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dfad8-5494-4c52-ba85-8bd20cead73b None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:58.493325 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dfad8-5494-4c52-ba85-8bd20cead73b None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:58.493601 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dfad8-5494-4c52-ba85-8bd20cead73b None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:58.495015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 611/1198] 10.222.0.15 () {54 vars in 912 bytes} [Thu Aug 11 18:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:32:58.500444 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b617-14f0-4eb8-9593-afba39018801 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:58.500729 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b617-14f0-4eb8-9593-afba39018801 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:58.501003 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b617-14f0-4eb8-9593-afba39018801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:58.520176 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=62 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:32:58.520919 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6935b617-14f0-4eb8-9593-afba39018801 None None] MFA Rules not processed for user `685c28640ca84d2b8e85d47e64430cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:58.522048 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6935b617-14f0-4eb8-9593-afba39018801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:58.531394 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 588/1199] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 11 18:32:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:32:58.543271 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dfad8-5494-4c52-ba85-8bd20cead73b None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:58.545037 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-d01dfad8-5494-4c52-ba85-8bd20cead73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:58.559542 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dfad8-5494-4c52-ba85-8bd20cead73b None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:58.563840 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3aee8-49cd-4a26-897e-3e2d022ce5a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c47252a3e4bc4b592475797aa202a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:58.564438 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3aee8-49cd-4a26-897e-3e2d022ce5a4 service glance] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:58.564714 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3aee8-49cd-4a26-897e-3e2d022ce5a4 service glance] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:58.564993 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3aee8-49cd-4a26-897e-3e2d022ce5a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:58.574522 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3aee8-49cd-4a26-897e-3e2d022ce5a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:58.575995 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3aee8-49cd-4a26-897e-3e2d022ce5a4 service glance] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:58.587109 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 612/1200] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:32:58 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:32:59.055080 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25355-cbb0-4837-aa7e-553b27ce855e None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.055808 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25355-cbb0-4837-aa7e-553b27ce855e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.055808 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25355-cbb0-4837-aa7e-553b27ce855e None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.058816 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 589/1201] 10.222.0.15 () {54 vars in 912 bytes} [Thu Aug 11 18:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:32:59.062851 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788cff4-3c85-4a6b-aeb3-3f4dea64d4b0 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.063223 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788cff4-3c85-4a6b-aeb3-3f4dea64d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.063697 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788cff4-3c85-4a6b-aeb3-3f4dea64d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.087928 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-0788cff4-3c85-4a6b-aeb3-3f4dea64d4b0 None None] MFA Rules not processed for user `55256cb1c7f743ffa544dbd388103ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:59.089157 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-0788cff4-3c85-4a6b-aeb3-3f4dea64d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:59.144554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 613/1202] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 11 18:32:59 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:32:59.155959 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb25355-cbb0-4837-aa7e-553b27ce855e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:59.168704 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb25355-cbb0-4837-aa7e-553b27ce855e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:59.172569 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962b99-9cc7-4571-b51a-11d3e435422a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:59.173165 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962b99-9cc7-4571-b51a-11d3e435422a service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.173463 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962b99-9cc7-4571-b51a-11d3e435422a service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.173737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962b99-9cc7-4571-b51a-11d3e435422a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.182866 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80962b99-9cc7-4571-b51a-11d3e435422a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:59.184351 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80962b99-9cc7-4571-b51a-11d3e435422a service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:59.187658 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:32:59.193213 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 590/1203] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:32:59 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:32:59.682944 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eeb7e-23b0-4710-9e74-29fe80d65f65 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.683396 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eeb7e-23b0-4710-9e74-29fe80d65f65 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.683502 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eeb7e-23b0-4710-9e74-29fe80d65f65 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.684803 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 614/1204] 10.222.0.15 () {54 vars in 962 bytes} [Thu Aug 11 18:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:32:59.686058 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a758adf-83f6-4a3c-907e-a7c97aa7cb38 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.686344 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a758adf-83f6-4a3c-907e-a7c97aa7cb38 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.686619 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a758adf-83f6-4a3c-907e-a7c97aa7cb38 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.688444 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 591/1205] 10.222.0.15 () {54 vars in 961 bytes} [Thu Aug 11 18:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:32:59.692733 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186ad9b-5014-499d-88e7-eaba8bf1d667 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.693109 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186ad9b-5014-499d-88e7-eaba8bf1d667 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.693388 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186ad9b-5014-499d-88e7-eaba8bf1d667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.694596 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4bb68-3588-451c-bf9e-e706f804dd25 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.694905 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4bb68-3588-451c-bf9e-e706f804dd25 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.695173 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4bb68-3588-451c-bf9e-e706f804dd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.715447 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-5da4bb68-3588-451c-bf9e-e706f804dd25 None None] MFA Rules not processed for user `3b58fad7b1e14a5f8c492a76a8840d44`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:59.716031 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-0186ad9b-5014-499d-88e7-eaba8bf1d667 None None] MFA Rules not processed for user `685c28640ca84d2b8e85d47e64430cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:59.716634 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-5da4bb68-3588-451c-bf9e-e706f804dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:59.717787 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-0186ad9b-5014-499d-88e7-eaba8bf1d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:59.728049 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 615/1206] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Aug 11 18:32:59 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:32:59.733533 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc2e2c-20e7-4705-995f-2ae3b4778b9e None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.733832 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc2e2c-20e7-4705-995f-2ae3b4778b9e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.734118 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc2e2c-20e7-4705-995f-2ae3b4778b9e None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.739155 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 616/1207] 10.222.0.15 () {54 vars in 912 bytes} [Thu Aug 11 18:32:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 18:32:59.741609 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cb372-f045-4a09-8511-089e695e56f8 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.741850 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cb372-f045-4a09-8511-089e695e56f8 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.742373 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cb372-f045-4a09-8511-089e695e56f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.770142 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-cd8cb372-f045-4a09-8511-089e695e56f8 None None] MFA Rules not processed for user `685c28640ca84d2b8e85d47e64430cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:32:59.771554 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-cd8cb372-f045-4a09-8511-089e695e56f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:59.781852 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 617/1208] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 11 18:32:59 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:32:59.792211 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 592/1209] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Aug 11 18:32:59 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:32:59.794149 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cb372-f045-4a09-8511-089e695e56f8 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:59.801961 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4bb68-3588-451c-bf9e-e706f804dd25 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:32:59.805900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cb372-f045-4a09-8511-089e695e56f8 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:59.810387 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0cf28-38d8-4e85-b686-98ed36617282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:59.811100 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0cf28-38d8-4e85-b686-98ed36617282 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.811455 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0cf28-38d8-4e85-b686-98ed36617282 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.811826 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0cf28-38d8-4e85-b686-98ed36617282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.813526 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4bb68-3588-451c-bf9e-e706f804dd25 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:32:59.820118 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e866-fbdd-42f0-9d04-961a2d0f6d7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b58fad7b1e14a5f8c492a76a8840d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:32:59.820734 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e866-fbdd-42f0-9d04-961a2d0f6d7a service placement] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:32:59.821015 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e866-fbdd-42f0-9d04-961a2d0f6d7a service placement] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:32:59.821287 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e866-fbdd-42f0-9d04-961a2d0f6d7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:32:59.823103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b788e866-fbdd-42f0-9d04-961a2d0f6d7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:32:59.824918 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0cf28-38d8-4e85-b686-98ed36617282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:59.826537 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0cf28-38d8-4e85-b686-98ed36617282 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:59.837560 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788e866-fbdd-42f0-9d04-961a2d0f6d7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:32:59.841274 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788e866-fbdd-42f0-9d04-961a2d0f6d7a service placement] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:32:59.841387 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 618/1210] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:32:59 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:32:59.855407 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 593/1211] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:32:59 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 18:33:09.834310 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=41 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:33:09.849860 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=36 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:33:11.544593 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da37b2-7c96-434c-b67a-0cca51dcee62 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:33:11.545098 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da37b2-7c96-434c-b67a-0cca51dcee62 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:33:11.545209 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da37b2-7c96-434c-b67a-0cca51dcee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:33:11.565195 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-71da37b2-7c96-434c-b67a-0cca51dcee62 None None] MFA Rules not processed for user `55256cb1c7f743ffa544dbd388103ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:33:11.566402 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-71da37b2-7c96-434c-b67a-0cca51dcee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:33:11.573676 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 619/1212] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Aug 11 18:33:11 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:33:11.586930 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e866-fbdd-42f0-9d04-961a2d0f6d7a service placement] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:33:11.596154 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e866-fbdd-42f0-9d04-961a2d0f6d7a service placement] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:33:11.600765 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962b4d5-f39e-4fe0-af33-24e099579633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:33:11.601353 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b4d5-f39e-4fe0-af33-24e099579633 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:33:11.601631 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b4d5-f39e-4fe0-af33-24e099579633 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:33:11.601901 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b4d5-f39e-4fe0-af33-24e099579633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:33:11.609775 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962b4d5-f39e-4fe0-af33-24e099579633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:33:11.610782 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962b4d5-f39e-4fe0-af33-24e099579633 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:33:11.628337 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 594/1213] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:33:11 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:33:12.643117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c06e5d-3490-4e84-ad83-5650c9bb9b46 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:33:12.643718 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c06e5d-3490-4e84-ad83-5650c9bb9b46 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:33:12.643933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c06e5d-3490-4e84-ad83-5650c9bb9b46 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:33:12.645547 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 620/1214] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 11 18:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:33:12.667095 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c0012-f0c0-422d-a3b7-fd0cec685472 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:33:12.667607 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c0012-f0c0-422d-a3b7-fd0cec685472 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:33:12.667692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c0012-f0c0-422d-a3b7-fd0cec685472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:33:12.698418 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ab1c0012-f0c0-422d-a3b7-fd0cec685472 None None] MFA Rules not processed for user `685c28640ca84d2b8e85d47e64430cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:33:12.699854 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ab1c0012-f0c0-422d-a3b7-fd0cec685472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:33:12.711880 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 595/1215] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 11 18:33:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:33:12.728148 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c06e5d-3490-4e84-ad83-5650c9bb9b46 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:33:12.747881 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c06e5d-3490-4e84-ad83-5650c9bb9b46 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:33:12.754379 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f7775-f850-460d-ae92-7ab2e7148a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:33:12.755304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f7775-f850-460d-ae92-7ab2e7148a1a service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:33:12.755785 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f7775-f850-460d-ae92-7ab2e7148a1a service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:33:12.755900 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f7775-f850-460d-ae92-7ab2e7148a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:33:12.765424 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f7775-f850-460d-ae92-7ab2e7148a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:33:12.767117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f7775-f850-460d-ae92-7ab2e7148a1a service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:33:12.778511 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 621/1216] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:33:12 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:33:18.306466 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710024-1248-4060-9c04-b93a7e47d040 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:33:18.307072 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710024-1248-4060-9c04-b93a7e47d040 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:33:18.307242 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710024-1248-4060-9c04-b93a7e47d040 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:33:18.308665 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 596/1217] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 11 18:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:33:18.317974 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5863-f046-48b9-8aab-1338560eaae1 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:33:18.318510 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5863-f046-48b9-8aab-1338560eaae1 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:33:18.318860 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5863-f046-48b9-8aab-1338560eaae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:33:18.338502 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-49ce5863-f046-48b9-8aab-1338560eaae1 None None] MFA Rules not processed for user `685c28640ca84d2b8e85d47e64430cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:33:18.339759 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-49ce5863-f046-48b9-8aab-1338560eaae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:33:18.349019 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 622/1218] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 11 18:33:18 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 18:33:18.361071 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c710024-1248-4060-9c04-b93a7e47d040 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:33:18.376014 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c710024-1248-4060-9c04-b93a7e47d040 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:33:18.384327 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57315e-4078-449b-8082-7178cf92144b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:33:18.384938 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57315e-4078-449b-8082-7178cf92144b service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:33:18.385218 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57315e-4078-449b-8082-7178cf92144b service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:33:18.385495 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57315e-4078-449b-8082-7178cf92144b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:33:18.394711 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57315e-4078-449b-8082-7178cf92144b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:33:18.396354 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57315e-4078-449b-8082-7178cf92144b service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:33:18.407265 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 597/1219] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:33:18 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:33:28.333349 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=12 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:33:28.402390 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=15 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:33:35.667743 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5863-f046-48b9-8aab-1338560eaae1 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:33:35.677097 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5863-f046-48b9-8aab-1338560eaae1 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:33:35.680610 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12610716-d425-4102-9ac7-931d42c09945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:33:35.681206 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12610716-d425-4102-9ac7-931d42c09945 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:33:35.681484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12610716-d425-4102-9ac7-931d42c09945 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:33:35.681755 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12610716-d425-4102-9ac7-931d42c09945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:33:35.691241 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12610716-d425-4102-9ac7-931d42c09945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:33:35.692752 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12610716-d425-4102-9ac7-931d42c09945 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:33:35.709053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 623/1220] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:33:35 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:33:45.697948 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=6 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:34:47.665977 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72f20-ecb2-4b1f-877c-be346b928422 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:34:47.666488 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72f20-ecb2-4b1f-877c-be346b928422 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:34:47.666578 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72f20-ecb2-4b1f-877c-be346b928422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:34:47.685516 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-d1b72f20-ecb2-4b1f-877c-be346b928422 None None] MFA Rules not processed for user `84b5b864adc046aaa582a5cb74f73483`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:34:47.686747 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-d1b72f20-ecb2-4b1f-877c-be346b928422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:34:47.694110 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 598/1221] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:34:47 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:34:48.015142 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f0391-a1ac-4915-8670-88f76732101c None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:34:48.015651 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f0391-a1ac-4915-8670-88f76732101c None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:34:48.015732 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f0391-a1ac-4915-8670-88f76732101c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:34:48.034609 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-6d5f0391-a1ac-4915-8670-88f76732101c None None] MFA Rules not processed for user `55256cb1c7f743ffa544dbd388103ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:34:48.035840 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-6d5f0391-a1ac-4915-8670-88f76732101c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:34:48.042825 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 624/1222] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Aug 11 18:34:48 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:34:48.054839 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b72f20-ecb2-4b1f-877c-be346b928422 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:34:48.064228 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b72f20-ecb2-4b1f-877c-be346b928422 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:34:48.067974 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f166-3de9-4bf0-8e56-d71008503fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:34:48.075384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f166-3de9-4bf0-8e56-d71008503fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:34:48.075384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f166-3de9-4bf0-8e56-d71008503fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:34:48.075384 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f166-3de9-4bf0-8e56-d71008503fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:34:48.076562 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40f166-3de9-4bf0-8e56-d71008503fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:34:48.077986 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40f166-3de9-4bf0-8e56-d71008503fd3 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:34:48.086108 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 599/1223] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:34:48 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:34:58.029879 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=3 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:34:58.082552 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=9 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:35:25.306155 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d59003-90c6-4680-ac32-3ac7d8d01dfa None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:35:25.306757 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d59003-90c6-4680-ac32-3ac7d8d01dfa None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:35:25.306844 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d59003-90c6-4680-ac32-3ac7d8d01dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:35:25.334842 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-00d59003-90c6-4680-ac32-3ac7d8d01dfa None None] MFA Rules not processed for user `84b5b864adc046aaa582a5cb74f73483`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:35:25.336045 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-00d59003-90c6-4680-ac32-3ac7d8d01dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:35:25.359529 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 625/1224] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:35:25 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:35:35.357519 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=15 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:35:43.096895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0db2c7-9e28-475e-9974-add42281fa0d None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:35:43.097371 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0db2c7-9e28-475e-9974-add42281fa0d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:35:43.097463 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0db2c7-9e28-475e-9974-add42281fa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:35:43.116205 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-7a0db2c7-9e28-475e-9974-add42281fa0d None None] MFA Rules not processed for user `84b5b864adc046aaa582a5cb74f73483`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:35:43.117410 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-7a0db2c7-9e28-475e-9974-add42281fa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:35:43.124161 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 600/1225] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:35:43 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:35:53.111166 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:36:03.242127 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d59003-90c6-4680-ac32-3ac7d8d01dfa None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:36:03.288914 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d59003-90c6-4680-ac32-3ac7d8d01dfa None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:36:03.294405 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd120e3-7db9-41d4-b221-d22b5dc9357a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b58fad7b1e14a5f8c492a76a8840d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:36:03.295032 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd120e3-7db9-41d4-b221-d22b5dc9357a service placement] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:36:03.295311 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd120e3-7db9-41d4-b221-d22b5dc9357a service placement] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:36:03.295579 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd120e3-7db9-41d4-b221-d22b5dc9357a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:36:03.304968 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd120e3-7db9-41d4-b221-d22b5dc9357a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:36:03.306486 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd120e3-7db9-41d4-b221-d22b5dc9357a service placement] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:36:03.317117 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 626/1226] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:36:03 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:36:13.312092 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=19 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:37:03.716412 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d9697-96ba-484b-9d21-c2be4cf1092c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:37:03.716916 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d9697-96ba-484b-9d21-c2be4cf1092c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:37:03.717009 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d9697-96ba-484b-9d21-c2be4cf1092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:37:03.737018 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-733d9697-96ba-484b-9d21-c2be4cf1092c None None] MFA Rules not processed for user `84b5b864adc046aaa582a5cb74f73483`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:37:03.738230 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-733d9697-96ba-484b-9d21-c2be4cf1092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:37:03.748189 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 601/1227] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:37:03 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:37:08.768715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34a814-c677-40f6-aaa4-aaaa5c20118e None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:37:08.768715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34a814-c677-40f6-aaa4-aaaa5c20118e None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:37:08.768715 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34a814-c677-40f6-aaa4-aaaa5c20118e None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:37:08.772506 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 627/1228] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 11 18:37:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:37:08.777516 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431375-dc0f-4c82-ba66-490bc623a576 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:37:08.777941 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431375-dc0f-4c82-ba66-490bc623a576 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:37:08.778103 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431375-dc0f-4c82-ba66-490bc623a576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:37:08.877609 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-a3431375-dc0f-4c82-ba66-490bc623a576 None None] MFA Rules not processed for user `685c28640ca84d2b8e85d47e64430cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:37:08.879128 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-a3431375-dc0f-4c82-ba66-490bc623a576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:37:08.907880 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 602/1229] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 11 18:37:08 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:37:08.918326 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34a814-c677-40f6-aaa4-aaaa5c20118e None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:37:08.940882 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34a814-c677-40f6-aaa4-aaaa5c20118e None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:37:08.952538 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde866eb-0cc3-4758-982c-aacf1e1921cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:37:08.953255 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde866eb-0cc3-4758-982c-aacf1e1921cc service nova] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:37:08.953668 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde866eb-0cc3-4758-982c-aacf1e1921cc service nova] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:37:08.954196 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde866eb-0cc3-4758-982c-aacf1e1921cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:37:08.964878 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde866eb-0cc3-4758-982c-aacf1e1921cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:37:08.967124 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde866eb-0cc3-4758-982c-aacf1e1921cc service nova] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:37:08.984496 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 628/1230] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:37:08 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:37:18.898354 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=29 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:37:18.979460 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=6 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:37:19.377746 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3431375-dc0f-4c82-ba66-490bc623a576 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:37:19.398945 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3431375-dc0f-4c82-ba66-490bc623a576 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:37:19.403039 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaae45-27bb-4002-a798-c9b12faa65b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:37:19.403683 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaae45-27bb-4002-a798-c9b12faa65b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:37:19.403982 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaae45-27bb-4002-a798-c9b12faa65b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:37:19.404226 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaae45-27bb-4002-a798-c9b12faa65b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:37:19.415031 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaae45-27bb-4002-a798-c9b12faa65b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:37:19.417171 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaae45-27bb-4002-a798-c9b12faa65b0 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:37:19.429774 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 603/1231] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:37:19 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:37:29.423712 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=10 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:37:29.987304 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2013-116e-49df-89be-dd433b3ef112 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:37:29.987801 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2013-116e-49df-89be-dd433b3ef112 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:37:29.987897 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2013-116e-49df-89be-dd433b3ef112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:37:30.007687 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-9ded2013-116e-49df-89be-dd433b3ef112 None None] MFA Rules not processed for user `69c8be94fe834f34b8ce9ae8cb309472`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:37:30.009101 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-9ded2013-116e-49df-89be-dd433b3ef112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:37:30.016004 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 629/1232] 10.222.0.15 () {58 vars in 958 bytes} [Thu Aug 11 18:37:29 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:37:40.003763 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=3 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:37:48.544278 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaae45-27bb-4002-a798-c9b12faa65b0 service neutron] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:37:48.555944 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaae45-27bb-4002-a798-c9b12faa65b0 service neutron] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:37:48.561081 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f496db-5eda-4366-a44d-96a6e4245d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:37:48.561669 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f496db-5eda-4366-a44d-96a6e4245d3b service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:37:48.562069 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f496db-5eda-4366-a44d-96a6e4245d3b service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:37:48.562353 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f496db-5eda-4366-a44d-96a6e4245d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:37:48.570155 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f496db-5eda-4366-a44d-96a6e4245d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:37:48.571784 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f496db-5eda-4366-a44d-96a6e4245d3b service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:37:48.581424 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 604/1233] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:37:48 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:37:58.576748 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=6 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:38:02.528634 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded2013-116e-49df-89be-dd433b3ef112 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:38:02.538546 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded2013-116e-49df-89be-dd433b3ef112 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:38:02.542002 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3dffc-5586-44ee-8a4e-2a10e4d511b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:38:02.542597 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3dffc-5586-44ee-8a4e-2a10e4d511b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:38:02.542907 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3dffc-5586-44ee-8a4e-2a10e4d511b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:38:02.543182 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3dffc-5586-44ee-8a4e-2a10e4d511b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:38:02.552856 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3dffc-5586-44ee-8a4e-2a10e4d511b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:38:02.554263 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3dffc-5586-44ee-8a4e-2a10e4d511b0 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:38:02.564222 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 630/1234] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:38:02 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:38:03.097123 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f496db-5eda-4366-a44d-96a6e4245d3b service nova] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:38:03.109408 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f496db-5eda-4366-a44d-96a6e4245d3b service nova] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:38:03.114320 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc90c7-a500-4fb4-b86e-e9de6f9ef60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:38:03.115069 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc90c7-a500-4fb4-b86e-e9de6f9ef60e service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:38:03.115572 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc90c7-a500-4fb4-b86e-e9de6f9ef60e service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:38:03.115917 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc90c7-a500-4fb4-b86e-e9de6f9ef60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:38:03.128130 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc90c7-a500-4fb4-b86e-e9de6f9ef60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:38:03.130401 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc90c7-a500-4fb4-b86e-e9de6f9ef60e service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:38:03.141706 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 605/1235] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:38:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:38:12.559802 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=6 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:38:13.136631 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=6 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:38:26.609177 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3dffc-5586-44ee-8a4e-2a10e4d511b0 service neutron] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:38:26.617568 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3dffc-5586-44ee-8a4e-2a10e4d511b0 service neutron] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:38:26.621686 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bd08b-af54-4c54-a63e-6da6534b541b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:38:26.622292 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bd08b-af54-4c54-a63e-6da6534b541b service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:38:26.622568 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bd08b-af54-4c54-a63e-6da6534b541b service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:38:26.622874 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bd08b-af54-4c54-a63e-6da6534b541b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:38:26.629806 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bd08b-af54-4c54-a63e-6da6534b541b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:38:26.631289 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bd08b-af54-4c54-a63e-6da6534b541b service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:38:26.639605 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 631/1236] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:38:26 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:38:36.635621 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=6 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:39:17.219422 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc90c7-a500-4fb4-b86e-e9de6f9ef60e service neutron] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:39:17.236167 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc90c7-a500-4fb4-b86e-e9de6f9ef60e service neutron] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:39:17.244174 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae7996-65b0-4fc3-9e78-eb8386cfd0e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:39:17.244985 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae7996-65b0-4fc3-9e78-eb8386cfd0e5 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:17.245420 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae7996-65b0-4fc3-9e78-eb8386cfd0e5 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:17.245895 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae7996-65b0-4fc3-9e78-eb8386cfd0e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:17.255559 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae7996-65b0-4fc3-9e78-eb8386cfd0e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:39:17.257711 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae7996-65b0-4fc3-9e78-eb8386cfd0e5 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:39:17.277951 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 606/1237] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:39:17 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:39:27.266795 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=6 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:39:31.173442 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bd08b-af54-4c54-a63e-6da6534b541b service neutron] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:39:31.182165 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bd08b-af54-4c54-a63e-6da6534b541b service neutron] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:39:31.185870 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e84c7-d243-4877-a2e3-4d95370b7a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:39:31.186454 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e84c7-d243-4877-a2e3-4d95370b7a10 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:31.187040 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e84c7-d243-4877-a2e3-4d95370b7a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:31.187320 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e84c7-d243-4877-a2e3-4d95370b7a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:31.257390 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e84c7-d243-4877-a2e3-4d95370b7a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:39:31.258852 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e84c7-d243-4877-a2e3-4d95370b7a10 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:39:31.277660 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 632/1238] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:39:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 18:39:35.013654 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69a20-4536-4975-9d85-8580ab9a7d38 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:35.014152 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69a20-4536-4975-9d85-8580ab9a7d38 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:35.014351 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69a20-4536-4975-9d85-8580ab9a7d38 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:35.015840 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 607/1239] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 11 18:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:39:35.054445 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac365b-4668-4213-8516-860a784bf459 None None] REQUEST_METHOD: `POST` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:35.054933 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac365b-4668-4213-8516-860a784bf459 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:35.055018 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac365b-4668-4213-8516-860a784bf459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:35.092610 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.auth.core [None req-ffac365b-4668-4213-8516-860a784bf459 None None] MFA Rules not processed for user `3b58fad7b1e14a5f8c492a76a8840d44`. Rule list: `[]` (Enabled: `True`). {{(pid=88295) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:39:35.093824 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-ffac365b-4668-4213-8516-860a784bf459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:39:35.103473 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 633/1240] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 11 18:39:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:39:35.115099 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69a20-4536-4975-9d85-8580ab9a7d38 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:39:35.129033 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69a20-4536-4975-9d85-8580ab9a7d38 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:39:35.134019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca9744-53a9-44ae-a248-2bc5352ce02d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b58fad7b1e14a5f8c492a76a8840d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:39:35.134634 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca9744-53a9-44ae-a248-2bc5352ce02d service placement] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:35.134943 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca9744-53a9-44ae-a248-2bc5352ce02d service placement] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:35.135218 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca9744-53a9-44ae-a248-2bc5352ce02d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:35.143590 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca9744-53a9-44ae-a248-2bc5352ce02d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:39:35.150228 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca9744-53a9-44ae-a248-2bc5352ce02d service placement] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:39:35.154908 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 608/1241] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:39:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:39:39.008777 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b542-52b8-4fc7-97e2-f33e4bf0ed63 None None] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:39.009285 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b542-52b8-4fc7-97e2-f33e4bf0ed63 None None] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:39.009363 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b542-52b8-4fc7-97e2-f33e4bf0ed63 None None] PATH_INFO: `/` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:39.011048 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 634/1242] 10.222.0.15 () {54 vars in 921 bytes} [Thu Aug 11 18:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 18:39:39.023376 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572daf7c-2e1b-40ed-8878-16527e33a06f None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:39.023887 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572daf7c-2e1b-40ed-8878-16527e33a06f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:39.024164 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572daf7c-2e1b-40ed-8878-16527e33a06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:39.045723 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-572daf7c-2e1b-40ed-8878-16527e33a06f None None] MFA Rules not processed for user `3b58fad7b1e14a5f8c492a76a8840d44`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 18:39:39.047193 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-572daf7c-2e1b-40ed-8878-16527e33a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:39:39.056743 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 609/1243] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Aug 11 18:39:39 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 18:39:39.070186 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b542-52b8-4fc7-97e2-f33e4bf0ed63 None None] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:39:39.084664 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b542-52b8-4fc7-97e2-f33e4bf0ed63 None None] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:39:39.089860 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c34618-e5b9-4d46-a702-fe425330c3d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b58fad7b1e14a5f8c492a76a8840d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:39:39.090444 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34618-e5b9-4d46-a702-fe425330c3d1 service placement] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:39.090753 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34618-e5b9-4d46-a702-fe425330c3d1 service placement] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:39.091029 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34618-e5b9-4d46-a702-fe425330c3d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:39.099896 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c34618-e5b9-4d46-a702-fe425330c3d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:39:39.101451 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c34618-e5b9-4d46-a702-fe425330c3d1 service placement] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:39:39.111410 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 635/1244] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:39:39 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:39:39.188198 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572daf7c-2e1b-40ed-8878-16527e33a06f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:39:39.198853 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572daf7c-2e1b-40ed-8878-16527e33a06f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:39:39.203604 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:39:39.204224 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:39.205019 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:39.205289 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] PATH_INFO: `/v3/users/69c8be94fe834f34b8ce9ae8cb309472` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:39.206464 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c8be94fe834f34b8ce9ae8cb309472)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:39:39.208409 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:39:39.404858 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c8be94fe834f34b8ce9ae8cb309472'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:39.411750 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c8be94fe834f34b8ce9ae8cb309472'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:39.425296 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c8be94fe834f34b8ce9ae8cb309472'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:39.504670 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c8be94fe834f34b8ce9ae8cb309472'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:39.505312 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c8be94fe834f34b8ce9ae8cb309472'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:39.511656 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 610/1245] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 11 18:39:39 2022] DELETE /identity/v3/users/69c8be94fe834f34b8ce9ae8cb309472 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:39:39.769940 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c34618-e5b9-4d46-a702-fe425330c3d1 service placement] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:39:39.780668 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c34618-e5b9-4d46-a702-fe425330c3d1 service placement] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:39:39.838579 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:39:39.839241 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:39.839518 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:39.839786 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] PATH_INFO: `/v3/projects/360e08d4de334b9fa7e027999f9109e9` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:39.840884 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=360e08d4de334b9fa7e027999f9109e9)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:39:39.843087 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:39:39.936606 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:39:39.939497 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360e08d4de334b9fa7e027999f9109e9', 'request_id': 'req-485e5b66-8bf6-4439-8f1e-a679cb6630b3'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:39.945583 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360e08d4de334b9fa7e027999f9109e9', 'request_id': 'req-485e5b66-8bf6-4439-8f1e-a679cb6630b3'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.013358 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360e08d4de334b9fa7e027999f9109e9', 'request_id': 'req-485e5b66-8bf6-4439-8f1e-a679cb6630b3'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.037699 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] The token cache is being invalidate because project 360e08d4de334b9fa7e027999f9109e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 18:39:40.038095 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.038759 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.040235 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 636/1246] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 11 18:39:39 2022] DELETE /identity/v3/projects/360e08d4de334b9fa7e027999f9109e9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 18:39:40.044290 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:39:40.045691 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:39:40.059078 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadd8dd-dc59-430c-b6b2-d600fe1bfa21 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:39:40.115903 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:39:40.116525 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:40.116806 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:40.117079 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] PATH_INFO: `/v3/users/aa89b73000ea40a5ae8b44299cdd9c2d` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:40.118246 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa89b73000ea40a5ae8b44299cdd9c2d)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:39:40.120196 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:39:40.319914 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa89b73000ea40a5ae8b44299cdd9c2d'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.325147 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:39:40.327178 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa89b73000ea40a5ae8b44299cdd9c2d'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.339724 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa89b73000ea40a5ae8b44299cdd9c2d'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.436215 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa89b73000ea40a5ae8b44299cdd9c2d'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.436830 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa89b73000ea40a5ae8b44299cdd9c2d'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.443514 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 611/1247] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 11 18:39:40 2022] DELETE /identity/v3/users/aa89b73000ea40a5ae8b44299cdd9c2d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:39:40.655079 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:39:40.656562 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:39:40.673642 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e5b66-8bf6-4439-8f1e-a679cb6630b3 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:39:40.729617 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:39:40.730243 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:39:40.730526 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:39:40.730829 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] PATH_INFO: `/v3/projects/8e2a975bf30341a794575fa53f3e6099` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:39:40.732015 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2a975bf30341a794575fa53f3e6099)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:39:40.733858 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:39:40.849480 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2a975bf30341a794575fa53f3e6099', 'request_id': 'req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.855967 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2a975bf30341a794575fa53f3e6099', 'request_id': 'req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.928054 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2a975bf30341a794575fa53f3e6099', 'request_id': 'req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.940181 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] The token cache is being invalidate because project 8e2a975bf30341a794575fa53f3e6099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 18:39:40.940494 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.941130 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:39:40.942624 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 637/1248] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 11 18:39:40 2022] DELETE /identity/v3/projects/8e2a975bf30341a794575fa53f3e6099 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:39:50.516322 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=9,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:39:50.936391 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:DELETE=11,keystone:SELECT=63,keystone:INSERT=2 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:40:39.789149 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:40:39.790694 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:40:39.859610 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c2a4b-d1b0-4a37-87f6-09a58f5f6f6c admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:40:39.917015 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bbb08-37c1-446c-9cff-e220ade6a17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685c28640ca84d2b8e85d47e64430cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:40:39.917615 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bbb08-37c1-446c-9cff-e220ade6a17c service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:40:39.917890 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bbb08-37c1-446c-9cff-e220ade6a17c service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:40:39.918162 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bbb08-37c1-446c-9cff-e220ade6a17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:40:39.920026 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-d37bbb08-37c1-446c-9cff-e220ade6a17c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:40:39.978739 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bbb08-37c1-446c-9cff-e220ade6a17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:40:39.980582 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bbb08-37c1-446c-9cff-e220ade6a17c service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:40:39.989338 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 612/1249] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:40:39 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:40:49.985393 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=80 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:40:53.207005 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:40:53.208469 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:40:53.279994 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a0cf0-f6fb-4fa5-b17d-6f7023d18c3b admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:40:53.283659 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d175f6-afe2-4a46-8f6e-bbd4919d4531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55256cb1c7f743ffa544dbd388103ab2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:40:53.289509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d175f6-afe2-4a46-8f6e-bbd4919d4531 service neutron] REQUEST_METHOD: `GET` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:40:53.289509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d175f6-afe2-4a46-8f6e-bbd4919d4531 service neutron] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:40:53.289509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d175f6-afe2-4a46-8f6e-bbd4919d4531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:40:53.289509 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-c0d175f6-afe2-4a46-8f6e-bbd4919d4531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:40:53.347816 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d175f6-afe2-4a46-8f6e-bbd4919d4531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:40:53.349243 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d175f6-afe2-4a46-8f6e-bbd4919d4531 service neutron] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:40:53.359463 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 638/1250] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:40:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:41:00.105500 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bbb08-37c1-446c-9cff-e220ade6a17c service nova] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:41:00.107036 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-d37bbb08-37c1-446c-9cff-e220ade6a17c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:41:00.120849 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bbb08-37c1-446c-9cff-e220ade6a17c service nova] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:41:00.125678 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:41:00.126302 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:41:00.126620 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:41:00.126940 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] PATH_INFO: `/v3/users/84b5b864adc046aaa582a5cb74f73483` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:41:00.128053 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b5b864adc046aaa582a5cb74f73483)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:41:00.129996 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:41:00.398161 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b5b864adc046aaa582a5cb74f73483'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:00.405199 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b5b864adc046aaa582a5cb74f73483'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:00.417296 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b5b864adc046aaa582a5cb74f73483'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:00.474727 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b5b864adc046aaa582a5cb74f73483'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:00.475261 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b5b864adc046aaa582a5cb74f73483'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:00.481502 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 613/1251] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 11 18:41:00 2022] DELETE /identity/v3/users/84b5b864adc046aaa582a5cb74f73483 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:41:00.802609 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d175f6-afe2-4a46-8f6e-bbd4919d4531 service neutron] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:41:00.820225 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d175f6-afe2-4a46-8f6e-bbd4919d4531 service neutron] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:41:00.880530 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:41:00.881159 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:41:00.881437 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:41:00.881708 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] PATH_INFO: `/v3/projects/4d8281dcaf46470b92ce90c4d62108f8` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:41:00.882857 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8281dcaf46470b92ce90c4d62108f8)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:41:00.884790 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:41:00.974441 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:41:00.981484 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8281dcaf46470b92ce90c4d62108f8', 'request_id': 'req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:00.989155 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8281dcaf46470b92ce90c4d62108f8', 'request_id': 'req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.080609 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8281dcaf46470b92ce90c4d62108f8', 'request_id': 'req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.091449 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] The token cache is being invalidate because project 4d8281dcaf46470b92ce90c4d62108f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 18:41:01.091740 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.092362 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.094483 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 639/1252] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 11 18:41:00 2022] DELETE /identity/v3/projects/4d8281dcaf46470b92ce90c4d62108f8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:41:01.098746 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:41:01.100213 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:41:01.113692 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50cc2-c7f8-4537-992a-03db6380f1c4 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:41:01.178373 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:41:01.179045 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:41:01.179453 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:41:01.179737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] PATH_INFO: `/v3/users/86be54de751f4df589155aa1caeb2889` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:41:01.180868 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86be54de751f4df589155aa1caeb2889)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:41:01.182904 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:41:01.339845 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86be54de751f4df589155aa1caeb2889'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.347295 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86be54de751f4df589155aa1caeb2889'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.360490 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86be54de751f4df589155aa1caeb2889'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.362307 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:41:01.411587 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86be54de751f4df589155aa1caeb2889'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.412251 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86be54de751f4df589155aa1caeb2889'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.418341 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 614/1253] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Aug 11 18:41:01 2022] DELETE /identity/v3/users/86be54de751f4df589155aa1caeb2889 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:41:01.665940 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] Authenticating user token {{(pid=88295) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:41:01.667401 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.fernet_utils [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88295) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:41:01.683602 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbf2e4-c895-40c1-bc4f-1497fc9b16b6 admin admin] Validating token access rules against request {{(pid=88295) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:41:01.745146 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fec54a2c514363b52e38552e10c343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c912d6fcae45219e4abbd9eb74f129', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88295) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:41:01.745767 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:41:01.746053 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:41:01.746333 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] PATH_INFO: `/v3/projects/74dd83498adc47af87855a25f6d2fef1` {{(pid=88295) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:41:01.747592 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74dd83498adc47af87855a25f6d2fef1)` {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:41:01.749513 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] RBAC: Authorization granted {{(pid=88295) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:41:01.847480 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74dd83498adc47af87855a25f6d2fef1', 'request_id': 'req-6392fb16-e2f9-40bf-a46c-175882256f40'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.854060 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74dd83498adc47af87855a25f6d2fef1', 'request_id': 'req-6392fb16-e2f9-40bf-a46c-175882256f40'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.925591 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74dd83498adc47af87855a25f6d2fef1', 'request_id': 'req-6392fb16-e2f9-40bf-a46c-175882256f40'} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.936050 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] The token cache is being invalidate because project 74dd83498adc47af87855a25f6d2fef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88295) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 18:41:01.936336 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.936957 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG keystone.notifications [None req-6392fb16-e2f9-40bf-a46c-175882256f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88295) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 18:41:01.939294 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: [pid: 88295|app: 0|req: 640/1254] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Aug 11 18:41:01 2022] DELETE /identity/v3/projects/74dd83498adc47af87855a25f6d2fef1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 18:41:11.446150 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:41:11.933030 dv-osbrick-852824-1-ceph devstack@keystone.service[88295]: DEBUG dbcounter [-] [88295] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 18:42:01.166152 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 18:42:01.167573 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:42:01.251625 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f8e49-7106-46df-86a1-3a0cc7286106 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 18:42:01.311941 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fd44c-3bf8-474f-aaa3-7d6c5c381db9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b58fad7b1e14a5f8c492a76a8840d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a930d08c2f31471bbe6a66f5c626d22f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 18:42:01.312460 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fd44c-3bf8-474f-aaa3-7d6c5c381db9 service placement] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 18:42:01.312737 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fd44c-3bf8-474f-aaa3-7d6c5c381db9 service placement] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 18:42:01.313007 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fd44c-3bf8-474f-aaa3-7d6c5c381db9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 18:42:01.314740 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-8a0fd44c-3bf8-474f-aaa3-7d6c5c381db9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 18:42:01.326247 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fd44c-3bf8-474f-aaa3-7d6c5c381db9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 18:42:01.327857 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fd44c-3bf8-474f-aaa3-7d6c5c381db9 service placement] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 18:42:01.337465 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 615/1255] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Aug 11 18:42:01 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 18:42:11.333609 dv-osbrick-852824-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=63 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}